Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hi, Is This A Well Known Issue, That Running A Task In A Virtual Environment, Messes Up The Reproducibility Feature ?

Is this a well known issue, that running a task in a virtual environment, messes up the reproducibility feature ?

Posted 11 months ago
Votes Newest

Answers 3

Hi @<1546303254386708480:profile|DisgustedBear75> , what do you mean?

You get different results or your experiment fails?

Running in venv mode can be more prone to failure if you're running between different operating systems & python versions.

The default behavior of ClearML when running locally is to detect the packages used in the code execution (You can also provide specific packages manually or override auto detection entirely) and log them in the backend.

When a worker in a virtual environment mode picks up an experiment it will try to create a virtual environment using local python.

If some specific wheel versions aren't available to the python version the worker is running inside the virtual environment, the experiment will fail.

Is this your scenario?

Posted 11 months ago

This is why I'm wondering if running the initial experiment in local in a venv is the reason why clearml is struggling to reproduce the experiment

Posted 11 months ago

The experiment fails.
Yes this is my scenario.

Basically I'm using this command "Task.force_requirements_env_freeze(requirements_file='requirements.txt')" on a requirement file that I know is working in local (if i set up a venv with that requirement file, the script is running)

But when I clone and rerun the experiment, clearml isnt able to install the requirements (i checked and the same version of python is used)

Posted 11 months ago
3 Answers
11 months ago
11 months ago