Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, I'M Generating Pipelines From Tasks And There'S A Step That Requires Providing Outputs From The Parent Task To The Child, But I'D Like To Pass It As A Single List Of Values. I Was Planning To Use Parameter_Override To Pass A List Of Values, Each

Hi all,

I'm generating pipelines from tasks and there's a step that requires providing outputs from the parent task to the child, but I'd like to pass it as a single list of values. I was planning to use parameter_override to pass a list of values, each from a different parent. Is this possible? So far when I've tried passing a list of replacement values it doesn't appear to perform the variable substitution as expected. By that I mean if I were to pass 'Hydra/clearml.dataset_id': '${stage_etl.parameters.General/dataset_id}' , the value of ${stage_etl.parameters.General/dataset_id} will be substituted for the ID for the dataset. However, if I try and pass {'Hydra/s3_paths': ['${stage_inference_UKI_12.artifacts.LTV_Data.url}', '${stage_inference_UKI_24.artifacts.LTV_Data.url}']} , a list with multiple substitutions, it appears to not perform the substitutions. Any thoughts? Is there a better approach?

  
  
Posted one year ago
Votes Newest

Answers 2


I will add a gh issue. Is this part open source? Could I make a PR?

In the mean time I still need to implement this with the current version of ClearML. So the only way would be to have one variable per parent? Is there any smarter way to work around it?

  
  
Posted one year ago

Hi @<1545216070686609408:profile|EnthusiasticCow4> , this is not currently supported, I suggest adding a GitHub issue 🙂

  
  
Posted one year ago