Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Within A Clearml Task, Is It Possible To Checkout Another Task Code ? Context: I Have A Bit Of A Special Use-Case: We Train Our Model Using Clearml. Our Code Prep The Data: Download Images (We Are Not Using Clearml Dataset) And Bundle Labels Into A Dataf

Within a ClearML task, is it possible to checkout another task code ?

Context:
I have a bit of a special use-case: we train our model using ClearML. Our code prep the data: download images (we are not using clearml dataset) and bundle labels into a dataframe (df) then run training on it (computer vision model). We did not have inference code in the repo in the past.

I want now to be able to automatically run inference with the same data that been trained in the past. My plan is:

  1. start a ClearML task with another ClearML ID as parameter.
  2. in the task, given a ClearML ID, somehow "checkout" the corresponding code
  3. with the new python code, from current task, in a new file that does not exist in the checkout code, run the step that download image and bundle label to df. But instead of running the training code, this time do inference. Get the results and upload it as artifact to current task.

Step 2 is the one I am wondering if there are any existing API/function for that ? Or can you suggest me how can I hack/build one ?

  
  
Posted one month ago
Votes Newest

Answers 5


Hi ManiacalLizard2 , not sure I understand. You want to change the commit of a running task from inside the task?

  
  
Posted one month ago

  • Modify the "uncommited changes"
  • Enqueue the taskIs it possible to edit "uncommited changes" from a task via Python ??
  
  
Posted one month ago

Thanks SuccessfulKoala55 I missed that one.
I have been playing with exporting task, modifying the "diff" part and importing back as new task. Seems to work as desired. But set_script seems cleaner.

Love how flexible is ClearML !!!

  
  
Posted one month ago

ManiacalLizard2 this would be using Task.set_script() . However, I have a feeling your use case might also be somehow solvable with a pipeline?

  
  
Posted one month ago

kind of ....
Now I think about it, the best approach would be to:

  • Clone a task
  
  
Posted one month ago
155 Views
5 Answers
one month ago
one month ago
Tags
Similar posts