Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
SweetBadger76
Moderator
1 Question, 233 Answers
  Active since 10 January 2023
  Last activity one year ago

Reputation

0

Badges 1

4 × Eureka!
0 Votes
8 Answers
486 Views
0 Votes 8 Answers 486 Views
hello TartSeagull57 This is a bug introduced with version 1.4.1, for which we are working on a patch. The fix is actually in test, and should be released ver...
one year ago
0 Hi, That I'M Running The Line Dataset = Clearml.Dataset.Get (Dataset_Project = 'Datasets', Dataset_Tags = ....) I Get: File "/Root/.Clearml/Venvs-Builds/3.8/Lib/Python3.8/Site-Packages/Clearml/Datasets/Dataset.Py", Line 1534, In Get Dataset_Id = Cls

Hi SparklingElephant70
The function doesn't seem to find any datasets which project_name matches your request.
Some more detailed code on how you create your dataset, and how you try to retrieve it, could help me to better understand the issue 🙂

one year ago
0 Hi, That I'M Running The Line Dataset = Clearml.Dataset.Get (Dataset_Project = 'Datasets', Dataset_Tags = ....) I Get: File "/Root/.Clearml/Venvs-Builds/3.8/Lib/Python3.8/Site-Packages/Clearml/Datasets/Dataset.Py", Line 1534, In Get Dataset_Id = Cls

hi SparklingElephant70
i was asking myself about this datasets / .datasets / None
this None i weird : if you look at the example i sent, you should see the dataset name here. Just to be sure, can you confirm me than when you fire the command line you pass both dataset_project AND dataset_name ?

one year ago
0 Since V1.4.0, Our

This means that the function will create a directory structure at local_folder , which structure will be the same as the minio's. That is to say that it will create directories corresponding to the buckets there - thus your clearml directory, which is the bucket the function found in the server root

one year ago
0 Since V1.4.0, Our

the fact that the minio server is called "bucket" in the doc (

) is for sure confusing. i will check the reason of this choice, and also why we dont begin to build the structure from the bucket (the real one

)
i keep you updated

one year ago
0 Hi, That I'M Running The Line Dataset = Clearml.Dataset.Get (Dataset_Project = 'Datasets', Dataset_Tags = ....) I Get: File "/Root/.Clearml/Venvs-Builds/3.8/Lib/Python3.8/Site-Packages/Clearml/Datasets/Dataset.Py", Line 1534, In Get Dataset_Id = Cls

what bother me is that it worked until yesterday, and you didnt changed your code. So the only thing i can think of is a bug introduced with the new sdk version, that was released yesterday. I am inverstigating with the sdk team, i will keep you updated asap ! 🙂

one year ago
0 Since V1.4.0, Our

if i got you, clearml is a bucket, my_folder_of_interest is a sub bucket, inside clearml right ?

one year ago
0 If I Create A Dataset With

Hey UnevenDolphin73
Is there any particular reason why not to create the dataset ? I mean, you need to use it in different tasks, so it could make sense to create it , for it to exist on its own, and then to use it at will in any task, by simply retrieving its id (using Dataset.get)
Makes sense ?

one year ago
0 Since V1.4.0, Our

but in the other hand, when you parse your minio console, you have all the buckets shown as directories right ? there is no file in the root dir. So we used the same logic and decided to reproduce that very same structure. Thus when you will parse the local_folder, you will have the same structure as shown in the console

one year ago
0 Need

can you share some code ? about how you build the pipeline

one year ago
0 Need

can you describe the issue ?

one year ago
0 Need

When the pipeline or any step is executed, a task is created, and it name will be taken from the decorator parameters. Additionally, for a step, the name parameter is optional : if not provided, the function name will be used instead.

It seems to me that your script fails creating the pipeline controller task because it fails pulling the name parameter. which is weird ... Weird because in the last error line, we can see that name !

one year ago
0 Need

i dont know if it will help but here is what i would test :
remove temporary the task init in the controller use name and project parameters that dont have spaces in their name dont use services as a default queue

one year ago
0 Hi Everyone, Quick Question Regarding Minio And Logging:

yes everything that is downloaded is cached. The cache folder is in your config file :

` sdk {
# ClearML - default SDK configuration

storage {
    cache {
        # Defaults to system temp folder / cache
        default_base_dir: "~/.clearml/cache"
         size {
            # max_used_bytes = -1
            min_free_bytes = 10GB
            # cleanup_margin_percent = 5%
        }
    }

    direct_access: [
        # Objects matching are...
one year ago
0 Does Clearml Have Any Suggestions On Gpu And Non-Gpu Amis For The Autoscaler? The Two Default Ones In The Documentation Are Either:

Hi UnevenDolphin73
you can find AMI that could satisfy your needs in the AWS website. Simply enter a console, choose your region (upper-right) , enter EC2 -> launch instance
There you can choose your os, or type "deep learning" if you need GPU machines

If you need some help to find more specific machines, do not hesitate to ask me :)

one year ago
0 Hi I'M Looking Into How Clearml Supports Datasets And Dataset Versioning And I'M A Bit Confused. Is Dataset Versioning Not Supported At All In The Non-Enterprise Or Is Versioning Available By A Different Mechanism? I See That

Hi PanickyMoth78
There is indeed a versioning mechanism available for the open source version 🎉

The datasets keep track of their "genealogy" so you can easily access the version that you need through its ID

In order to create a child dataset, you simply have to use the parameter "parent_datasets" when you create your dataset : have a look at
https://clear.ml/docs/latest/docs/clearml_data/clearml_data_sdk#datasetcreate

You also alternatively squash datasets together to create a c...

one year ago
0 Hi, Bug Report. I Was Trying To Upload Data To S3 Via Clearml.Dataset Interface

thanks ! we have added quite a lot of new features on datasets on our last releases. I would encourage you to update your clearml packages 🙂

one year ago
0 Hey Guys! Has Anyone Ever Seen An Error Like This? I'M Using My Code In A

Hey
I'll play a bit with what you sent, because reproducing the issues help a lot to solve them. I keep you updated 😊

one year ago
0 Hey Guys! Has Anyone Ever Seen An Error Like This? I'M Using My Code In A

Hi SmugSnake6
I might have found you a solution 🎉 I answered on the GH thread https://github.com/allegroai/clearml-agent/issues/111

one year ago
0 Hi Guys, I Keep Receiving A Timeout Error:

Hi VexedPeacock35
can you share some more precisions about what occurs ?
What are you trying to do (or to be precise when does this error appeared ?)
What are your packages versions (clearml, and server if you are self-hosted)

one year ago
0 Hi, I Am Trying The Triggerscheduler To Catch When A User Add Specific Tag To A Task. I Used The Below Code But The Schedule_Function Is Not Called When Adding Tags To Task (It Seems The Task.Last_Update Is Not Modified After Adding Tag)

hi ApprehensiveSeahorse83
i am working too on your issue. It seems that there is a wrong behavior here, so we need to get a bit deeper to understand what's happening. We will keep you updated asap, thanks for your contribution ! 🙏

one year ago
0 Hi, I Am Trying The Triggerscheduler To Catch When A User Add Specific Tag To A Task. I Used The Below Code But The Schedule_Function Is Not Called When Adding Tags To Task (It Seems The Task.Last_Update Is Not Modified After Adding Tag)

yes i have the behavior. I think that we have a bug. We will release a fix and will keep you updated 🙂
can you please open a github issue ? Of course if it is a problem, i can do it for you, just let me know 🙂
http://github.com/allegroai/clearml/issues

one year ago
0 Hi, I Am Trying The Triggerscheduler To Catch When A User Add Specific Tag To A Task. I Used The Below Code But The Schedule_Function Is Not Called When Adding Tags To Task (It Seems The Task.Last_Update Is Not Modified After Adding Tag)

hey ApprehensiveSeahorse83
can you please check that the trigger is correctly added ? Simply retrieve the return value of add_task_trigger
res = trigger.add_task_trigger( .....
print(f'Trigger correctly added ? {res}')

one year ago
0 Hi All! Any Example Or Doc To Use Clearml With Slurm As A Workload Manager ?

Hi MoodySparrow34
We have an user that wrote this example https://github.com/marekcygan/clearml-slurm-workers
It is a simple glue code to spin SLURM workers when the tasks are enqueued. Hope it will help

one year ago
0 I’M Trying To Get The Meta-Information About The Code (Section Execution) To Be Auto-Filled, However When I Run The Script With The Pycharm Testrunner, It Is Missing. If I Use

it is a bit old - i recommand you to test again with the latest version 1.4.1
can you please give me some more details about what you intent to do ? it would be easier then to reproduce the issue

one year ago
0 I’M Trying To Get The Meta-Information About The Code (Section Execution) To Be Auto-Filled, However When I Run The Script With The Pycharm Testrunner, It Is Missing. If I Use

I have created the task with Task.create and pulled it with an agent, to change its status. The error now occurs when the agent builds the env : he tries to pull jb_pytest_runner from the repo.
We are working on a solution, I will keep you updated

one year ago
0 I’M Trying To Get The Meta-Information About The Code (Section Execution) To Be Auto-Filled, However When I Run The Script With The Pycharm Testrunner, It Is Missing. If I Use

Hi EnormousWorm79

The Pycharm testrunner wraps the script into a local cript, and thats what you are getting.
(jb pytest runner). Because it is local, you lose the source info

Let me check if I have a workaround or solution for you. I keep you updated

one year ago
Show more results compactanswers