Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Guys, I Encountered A Very Frustrating Problem About Virtual Enviroment Management When I Use Clearml. I Use Virtualenv To Create A New Python Env And Installed All The Needed Python Pakcages In The Env. The Env Path Is

Hi guys, I encountered a very frustrating problem about virtual enviroment management when I use ClearML. I use virtualenv to create a new python env and installed all the needed python pakcages in the env. The env path is /general-user/frank/mlflow_ray/env (so the python binary is /general-user/frank/mlflow_ray/env/bin/python ). I source the env and run python trian.py ... and the task and all the metrics and models are logged into ClearML webapp.

Now I clone the experiment/task on the ClearML webapp, and clear all the preinstall packages, and enqueue the task into a queue. The task is executed but failed to run because ClearML want to create a another new virtual env and it do not reuse I preinstalled one.

So, how can I set ClearML conf to reuse the preinstalled one?

  
  
Posted one year ago
Votes Newest

Answers 7


Hi ThoughtfulBadger56 ,

I think these are a the environment variables you're looking for:
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
https://clear.ml/docs/latest/docs/clearml_agent/clearml_agent_env_var

  
  
Posted one year ago

Thank you CostlyOstrich36 What's the difference between the two environment variables?
Shall I set export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/home/bar/env/bin/python3 or
export CLEARML_AGENT_SKIP_PYTHON_VENV_INSTALL=/home/bar/env/bin/python3 or
export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=/home/bar/env and
export CLEARML_AGENT_SKIP_PYTHON_VENV_INSTALL=/home/bar/env/bin/python3

  
  
Posted one year ago

The official doc just gives too much choices but less details about how to set them and the relationships.

  
  
Posted one year ago

I think the 3rd one, let me know what worked for you

  
  
Posted one year ago

None of them works... CostlyOstrich36 😵‍💫 😵‍💫 😵‍💫

  
  
Posted one year ago

I don't think you need to mix. For example if you have a pre-prepared environment then it should something like export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=<PATH_TO_ENV_BINARY>

  
  
Posted one year ago

Yes, I think you are right. Just set export CLEARML_AGENT_SKIP_PIP_VENV_INSTALL= /home/bar/env/bin/python3 .

  
  
Posted one year ago
951 Views
7 Answers
one year ago
one year ago
Tags
Similar posts