Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey Everyone, We'Re Running A Remote Execution (K8S Agent) Clearml Pipeline From Jupyterhub, But When The Agent Prepares The Environment, It Installs A Different Version Of The Packages Specified In Our

Hey everyone,
We're running a remote execution (K8S agent) ClearML pipeline from Jupyterhub, but when the agent prepares the environment, it installs a different version of the packages specified in our requirements.txt
This causes the pipeline to fail as boto3 and other packages do not support urllib3>=2.0.0 which is being installed.

urllib3==1.26.14 is specified both in our requirements.txt and inside the PipelineController 's packages parameter.
When the first task of the pipeline start executing it is defaulting to the latest urllib3 which causes the pipeline to immediately to fail.

How can this be fixed?

  
  
Posted one year ago
Votes Newest

Answers 7


In that case you have the "packages" parameter for both the controller and the steps

  
  
Posted one year ago

I think this is what you're looking for - None

  
  
Posted one year ago

We're using a pipeline, there is no Task object

  
  
Posted one year ago

Under add_step there is task_overrides and then you can find this section

reset requirements (the agent will use the "requirements.txt" inside the repo) task_overrides={'script.requirements.pip': ""}
  
  
Posted one year ago

We'll try it out, thanks

  
  
Posted one year ago

We've added {"script.requirements.pip": "urllib3==1.26.14"} in each step of the pipelines however it still installs urllib3 2.0.3

  
  
Posted one year ago

We've added that parameter under the controller, but that parameter doesn't exist for add_step() , is there an alternative?

  
  
Posted one year ago
933 Views
7 Answers
one year ago
one year ago
Tags
Similar posts