Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Clearml Tracks The Executed

ClearML tracks the executed .py file, so you can re-run the experiment. But...

  • With Metaflow DAGs, you pass a run argument to your training script, e.g. python train.py run
  • With Huggingface's accelerate framework, you invoke your training script with, e.g. accelerate launch train.py
    Is there a way to document these non-standard entry points with ClearML so that if we clone/enqueue a task they will be will be executed this way?
  
  
Posted one year ago
Votes Newest

Answers 5


do you have your Task.init call inside the "train.py" script ? (and if you do, what are you getting in the Execution tab of the task) ?

  
  
Posted one year ago

Hi @<1541954607595393024:profile|BattyCrocodile47> , how does ClearML react when you run the scripts this way? The repository is logged as usual?

  
  
Posted one year ago

Hi! Yes, it just logs the .py file.

  
  
Posted one year ago

Oh duh, thanks. What about non standard entrypoints (as opposed to arguments) like accelerate launch train.py ?

  
  
Posted one year ago

Is there a way to document these non-standard entry points

@<1541954607595393024:profile|BattyCrocodile47> you should see the "run" in the Args section under Configuration
in case of HF you should see "-m huggingface" and then the rest in the Args section
(if this does not work, then I assume this is a bug 🙂 )
The idea is of course that you can always enqueue and reproduce, so if that part is broken we should fix it 😊

  
  
Posted one year ago
882 Views
5 Answers
one year ago
one year ago
Tags