i found 🙂
CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
Hi @<1523702932069945344:profile|CheerfulGorilla72>
the agent is Always inherits from the docker system installed environment
If you have a custom venv inside the docker that is Not activated by default you can set the agent to use it:
None
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
See the CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
and CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
env vars here None
@<1523701205467926528:profile|AgitatedDove14>
Can you please tell me how to return the folder where the script should run?
Traceback (most recent call last):
File "/root/.clearml/venvs-builds/3.7/code/train.py", line 12, in <module>
from src.utils.profiler.time_profiler import TimeProfiler
ModuleNotFoundError: No module named 'src'
/root/.clearml/venvs-builds/3.7/code/ -> /src/project
i use:
export CLEARML_AGENT_EXTRA_DOCKER_ARGS=" -v /srv:/root/srv -v /srv:/srv -v /var/run/docker.sock:/var/run/docker.sock -v /home/user/mlbox/clearml.conf:/root/clearml.conf --network=host --ipc host --hostname=\$(hostname)"
@<1523701070390366208:profile|CostlyOstrich36>
Can you please tell me how to return the folder where the script should run?
add it to the python path
PYTHONPATH="/src/project"
cp does't work
cp: target '/root/.clearml/venvs-builds/3.7/code' is not a directory
i added the required dependencies but don't feel like doing /srv/project:/root/.clearml/venvs-builds/3.7/code
although okay, if it helps to start working, then you can do it like that ...
like this?
export CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL="True"
upd: it's work!!!
Thanks a lot!
@<1523701205467926528:profile|AgitatedDove14>
Thanks a lot!
and if there is no venv and I want to use what is there by default in the docker?
and you can make it so that the version of python (to 3.10) would not be switched, but the one that is the default remains?
Hi @<1523702932069945344:profile|CheerfulGorilla72> , I think you need to map out the relevant folders for the docker. You can add docker arguments to the task using Task.set_base_docker
add it to the python path
PYTHONPATH="/src/project"
this allowed the script to run!
but now he does not see the folders that are in the /src/project folder"
can you please tell me how to make it so that he can see
this is for hydra launch
Current working directory ('os.getcwd()') : /root/.clearml/venvs-builds/3.7/code
Check that the config directory '/root/.clearml/venvs-builds/3.7/code/conf' exists and readable