Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! Trying To Orchestrate A Pipeline On Multiple Agents For The First Time. I Am Setting Up The Pipeline From Functions And I Need The Individual Function Steps To Run From A Cloned Repository Due To Local Imports. The Pipeline Task Detects And Clones The

Hi! Trying to orchestrate a pipeline on multiple agents for the first time. I am setting up the pipeline from functions and I need the individual function steps to run from a cloned repository due to local imports. The pipeline task detects and clones the repository but the individual steps do not. What am I missing? Do I need to set the pipeline from tasks in order to do that?

  
  
Posted 2 months ago
Votes Newest

Answers 8


yes, they are. It's basically the same script as the pipeline_from_functions.py example on clearml github but I need to import local modules from a private repository inside the steps.

  
  
Posted 2 months ago

Hi @<1547028074090991616:profile|ShaggySwan64> , can you please provide minimal sample code that reproduces this? The local imports - are they from the private repo?

  
  
Posted 2 months ago

yes, I only have a single repository. The pipeline and the individual steps are implemented in the same folder but although the controller task runs fine and the repo is cloned on the agent, the function step agents only pull the single .py file.

  
  
Posted 2 months ago

Can you please add log of all related runs including the pipeline controller

  
  
Posted 2 months ago

I know I can specify the repo manually in the add_funciton_step call but I would like to keep the execution from the parent pipeline task, including uncomitted changes etc.

  
  
Posted 2 months ago

I think the controller and steps need to be in the same repository

  
  
Posted 2 months ago

They are in the same repository.

  
  
Posted 2 months ago

Same repo as the private repo?

  
  
Posted 2 months ago