Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Guys, I Encountered A Very Frustrating Problem About Virtual Enviroment Management When I Use Clearml. I Use Virtualenv To Create A New Python Env And Installed All The Needed Python Pakcages In The Env. The Env Path Is

Hi guys, I encountered a very frustrating problem about virtual enviroment management when I use ClearML. I use virtualenv to create a new python env and installed all the needed python pakcages in the env. The env path is /general-user/frank/mlflow_ray/env (so the python binary is /general-user/frank/mlflow_ray/env/bin/python ). I source the env and run python trian.py ... and the task and all the metrics and models are logged into ClearML webapp.

Now I clone the experiment/task on the ClearML webapp, and clear all the preinstall packages, and enqueue the task into a queue. The task is executed but failed to run because ClearML want to create a another new virtual env and it do not reuse I preinstalled one.

So, how can I set ClearML conf to reuse the preinstalled one?

  
  
Posted one year ago
Votes Newest

Answers 7


Yes, I think you are right. Just set export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL= /home/bar/env/bin/python3 .

  
  
Posted one year ago

I don't think you need to mix. For example if you have a pre-prepared environment then it should something like export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=<PATH_TO_ENV_BINARY>

  
  
Posted one year ago

None of them works... CostlyOstrich36 😵‍💫 😵‍💫 😵‍💫

  
  
Posted one year ago

I think the 3rd one, let me know what worked for you

  
  
Posted one year ago

The official doc just gives too much choices but less details about how to set them and the relationships.

  
  
Posted one year ago

Thank you CostlyOstrich36 What's the difference between the two environment variables?
Shall I set export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/home/bar/env/bin/python3 or
export CLEARML_AGENT_SKIP_PYTHON_VENV_INSTALL=/home/bar/env/bin/python3 or
export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/home/bar/env and
export CLEARML_AGENT_SKIP_PYTHON_VENV_INSTALL=/home/bar/env/bin/python3

  
  
Posted one year ago

Hi ThoughtfulBadger56 ,

I think these are a the environment variables you're looking for:
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
https://clear.ml/docs/latest/docs/clearml_agent/clearml_agent_env_var

  
  
Posted one year ago
950 Views
7 Answers
one year ago
one year ago
Tags
Similar posts