Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Okay, 3Rd Question In A Row Here, You Guys Are So Helpful Here!! Okay So Is There Some Kind Of Script That Launches When Say You "Publish" An Experiment So That You Can Get The

Okay, 3rd question in a row here, you guys are so helpful here!! Okay so is there some kind of script that launches when say you "publish" an experiment so that you can get the latest edit: best known artifacts from a task of that experiment ?

Say you've ran a bunch of experiments with different layer sizes, nodes per layer, optimizer, etc. and you like the 2nd one the best so you want to set that as the "staging" or "production" model. Is there some kind of script that might be monitoring for these changes and then maybe upload the latest one to an s3 bucket or whatever? So later anyone can download from that bucket or even ClearML server to grab the best model we have. I wonder if the Slack_alerts.py does something like this where can do the monitoring...

For a basic idea, I was thinking of doing a cron job from the host machine where every 5 minutes, it'll look at a certain experiment and see what the newest promoted or tagged or published item.

Side note: If possible, can we have a "only one experiment can be given a single tag" ? MLFlow has this functionality where if you promote one item to staging or production, then whatever is already in staging or production will get replaced by your newest (and notify you before you confirm).

Thanks in advance as always!

  
  
Posted 3 years ago
Votes Newest

Answers 11


This can be the "production tag" where a single task with the best results should hold.

  
  
Posted 3 years ago

sorry, I'll update that. I meant like the best artifacts. So multiple artifacts of the same task that I thought was the best. It may or may not be the latest task.

  
  
Posted 3 years ago

If possible, can we have a "only one experiment can be given a single tag"

You mean "moving a tag" automatically (i.e. if someone else had the same tag it is removed from it)?

  
  
Posted 3 years ago

Thanks a lot AgitatedDove14 (Sorry for the late response) !!

  
  
Posted 3 years ago

so that you can get the latest artifacts of that experiment

what do you mean by " the latest artifacts "? do you have multiple artifacts on the same Task or s it the latest Task holding a specific artifact?

  
  
Posted 3 years ago

Yep, automatically moving a tag

No, but you can get the last created/updated one with that tag (so I guess the same?)

meant like the best artifacts.

So artifacts get be retrieved like a dict:
https://github.com/allegroai/clearml/blob/master/examples/reporting/artifacts_retrieval.py
Task.get_task(project_name='examples', task_name='artifacts example').artifacts['name']

  
  
Posted 3 years ago

Example Task.get_task(..., task_filter={'tags': ['best'], 'order_by': ["-last_update"]})

  
  
Posted 3 years ago

Ah the latest tag of production sounds good to me. Then I guess I can retrieve the artifacts from that specific latest tagged task then.

  
  
Posted 3 years ago

Yep, automatically moving a tag

  
  
Posted 3 years ago

I'll check them out for sure!

  
  
Posted 3 years ago