Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
StaleLeopard22
Moderator
4 Questions, 6 Answers
  Active since 13 July 2023
  Last activity 7 months ago

Reputation

0

Badges 1

6 × Eureka!
0 Votes
2 Answers
652 Views
0 Votes 2 Answers 652 Views
Hi all, Is there a limit to the maximum size, or number of files a dataset can have when uploading to ClearML self-hosted? We got this error when finalizing ...
10 months ago
0 Votes
2 Answers
476 Views
0 Votes 2 Answers 476 Views
7 months ago
0 Votes
2 Answers
471 Views
0 Votes 2 Answers 471 Views
7 months ago
0 Votes
5 Answers
531 Views
0 Votes 5 Answers 531 Views
Hi, does anyone know if dynamic environment variables work on the clearml client side as well? For example setting CLEARML__SDK__AWS__S3__USE_CREDENTIALS_CHA...
9 months ago
0 Hi All, Is There A Limit To The Maximum Size, Or Number Of Files A Dataset Can Have When Uploading To Clearml Self-Hosted? We Got This Error When

Thanks for your reply ๐Ÿ™‚

We worked around the bug by only calling Dataset.add_files once per folder that contains files (~120) using a wildcard, rather than for each individual file (~75,000)

I am unsure what effect this has, but I assume some log or other metadata was being created by the add_files method, and calling it less times made the mongodb document smaller?

[Mongo has a way to store documents larger than the 16MB limit using GridFS](https://www.mongodb.com/docs/manual/...

10 months ago
0 Hi, Does Anyone Know If

just for clarity this is the contents of my ~/clearml.conf file, I'd like to replace this with env vars for programatically setting the config rather than editing this file

sdk {
    aws {
        s3 {
            use_credentials_chain: true
        }
    }
}
9 months ago
0 Hi, Does Anyone Know If

Ah okay, thank you!

Would be cool if it worked on the SDK as well, in my case itโ€™s much easier to manage env vars than the config file

9 months ago
0 Hi, Does Anyone Know If

We are using the self-hosted server ๐Ÿ™‚

9 months ago
0 Hi Everyone, I Am Working On A Script That Gets Enqueued, And Executes Remotely On Clearml-Agent Workers. I Got A "Hello World" Version Of The Script Running, The Python Env Gets Set Up, And Installs Some Basic Packages I Need From Pypi. However, I Need T

Yes this solved it for me, although this is not ideal as pip will look in our private package repo and in PyPI for each dependency that is installed, slowing the environment setup process significantly

7 months ago
0 Hey All, We Have A Self-Hosted Clearml Server, Today We Launched ~40 Workers To Run Training Jobs On Our Queue, However We Started Getting Errors With Elasticsearch Connection Pool Being Full, And Subsequent Timeouts And Failed Tasks. Each Training Task

Additionally , Iโ€™d like to understand what is being stored in elasticsearch vs mongo, redis etc. from my understanding it is the metrics and console logs being stored in elastic?

Iโ€™m thinking the solution may be to reduce the amount of metrics logged by averaging them locally and only reporting them once every 60s or so?

Or is there a way to tune the config of elastic, allowing it to handle the high volume of requests

7 months ago