Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All I Am Would Like To Somehow Prevent Clearml Caching From Caching A Task That Hasn'T Uploaded Artifacts (Using Cache_Executed_Step In

Hi all
I am would like to somehow prevent clearml caching from caching a task that hasn't uploaded artifacts (using cache_executed_step in add_step )?
Can that be done?

  
  
Posted 11 months ago
Votes Newest

Answers 6


@<1533619716533260288:profile|SmallPigeon24> , failed task should not actually be reused (i.e. cached), are you saying a failed Task is being reused? or are you saying that you want to "invalidate" the cache in the execution but still leave the Task as completed ?

  
  
Posted 11 months ago

Yes. Sometimes, task (on HIL finish but fails on the HIL and does not produce output. Is it possible to not fail the task and still mark it as uncacheable?

  
  
Posted 11 months ago

If possible, I would like the second option and invalidate caching that completed task. But I am considreing just failing the task.

  
  
Posted 11 months ago

Hi @<1533619716533260288:profile|SmallPigeon24> , can you please elaborate on your usecase ?

  
  
Posted 11 months ago

But I am considreing just failing the task.

This will of course work, just raise exception in the Task itself, and protect the call from the pipeline logic function with try/except

regrading the second option, try to nullify the hash on the Component Task:

# running the Task component here
# if we do not want someone to use us
Task.current_task()._set_runtime_properties({"pipeline_job_hash": None})
  
  
Posted 11 months ago

Thank you!

  
  
Posted 11 months ago
780 Views
6 Answers
11 months ago
11 months ago
Tags