Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I Have A Question Regarding Multiple Parents: I Have A Pipe That Runs On Multiple Datasets, And The Last Step Does Something On The Bulk Of Those Sets (The Thing Itself Is Not Important). Sometimes One Of The Parents Fails Or Skipped Due To A Prev

Hi all, I have a question regarding multiple parents:
I have a pipe that runs on multiple datasets, and the last step does something on the bulk of those sets (the thing itself is not important).
sometimes one of the parents fails or skipped due to a previous step failing, and that is fine. I want the final step to run regardless on the state the of parent, as long as the parent finished running or skipped.
Currently, it doesn't. can you guide me?

  
  
Posted 6 months ago
Votes Newest

Answers 6


@<1523701070390366208:profile|CostlyOstrich36>

  
  
Posted 6 months ago

(We will deprecate continue_on_fail)

  
  
Posted 6 months ago

currently, D runs only if both C1 and C2 completed successfully

  
  
Posted 6 months ago

Hi @<1639799308809146368:profile|TritePigeon86> ! Please see continue_behaviour . You should be able to pass the parameter to your parent step. It is not documented yet, but it should be available in the latest version of clearml. See this for some documentation: None

  
  
Posted 6 months ago

Lets say I have 2 datasets, each runs steps A-C, with continue_on_fail=True. after, I have a sted D that does something at the end of pipeline. D should run if step C1 and C2 (C for set 1 and C for step 2) completed, failed, skipped or aborted (as long as none of them is still in queue or running)

  
  
Posted 6 months ago

Hi @<1639799308809146368:profile|TritePigeon86> , if I understand you correctly, you're basically looking for a switch in pipelines (per step) to say "even if step failed, continue the pipeline"?

  
  
Posted 6 months ago