Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Folks, Is There A Way To Force Clear-Ml Agent With --Docker To

hi folks, is there a way to force clear-ml agent with --docker to not create a virtualenv at all?
And perhaps not even attempt to install requirements even?

I have a docker I trust, and it’s much simpler if clear.ml uses the python libraries already installed and tested inside it in the system python env.

  
  
Posted 2 years ago
Votes Newest

Answers 10


Hi RoughTiger69

One quirk I found was that even with this flag on, the agent decides to install whatever is in the requirements.txt

Whats the clearml-agent you are using?

I just noticed that even when I clear the list of installed packages in the UI, upon startup, clearml agent still picks up the requirements.txt (after checking out the code) and tries to install it.

It can also just skip the entire Python installation with:
CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL=1

  
  
Posted 2 years ago

My bad you have to pass it to the container itself:
https://github.com/allegroai/clearml-agent/blob/a5a797ec5e5e3e90b115213c0411a516cab60e83/docs/clearml.conf#L149
extra_docker_arguments: ["-e", "CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL=1"]

  
  
Posted 2 years ago

SweetBadger76 thanks for your reply.
One quirk I found was that even with this flag on, the agent decides to install whatever is in the requirements.txt.

  
  
Posted 2 years ago

SweetBadger76 I think it’s not related to the flag or whether or not I am running in a virtual env.
I just noticed that even when I clear the list of installed packages in the UI, upon startup, clearml agent still picks up the requirements.txt (after checking out the code) and tries to install it.
I wonder if there’s a way to tell it to skip this step too?

  
  
Posted 2 years ago

will try it

  
  
Posted 2 years ago

Ahha! I see

  
  
Posted 2 years ago

hi Assaf
By default the agent runs in pip mode (not on docker).

The flag is the right one 🙂 CLEARML_AGENT_SKIP_PIP_VENV_INSTALL=1

You can also specify some requirements if you need to. The function is Task.add_requirements
https://clear.ml/docs/latest/docs/references/sdk/task#taskadd_requirements

  
  
Posted 2 years ago

hey RoughTiger69
Can you describe me how you are setting up the environment variable please ?

Setting up that flag will skip the virtual env installation : the agent will use your environment and the packages installed into it.

Using Task.add_requirements(requirements.txt) allows to add specific packages at will. Note that this function will be executed even with the flag CLEARML_AGENT_SKIP_PIP_VENV_INSTALL set

  
  
Posted 2 years ago

can you try to create an empty text file and provide its path to Task.force_requirements_env_freeze( your_empty_txt_file) ?

  
  
Posted 2 years ago

AgitatedDove14 yes, i am passing this flag to the agent with CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL=1 clearml-agent….
running inside docker
and it still tries to install the requirements.txt

Using 1.3.1

  
  
Posted 2 years ago
1K Views
10 Answers
2 years ago
one year ago
Tags