Hi @<1590514584836378624:profile|AmiableSeaturtle81> , I think these are the env variables you're looking for:
CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL
CLEARML_AGENT_FORCE_CODE_DIR
None
Hello, how can i run my tasks inside docker without installing anything at all. Assume that my image is ready to go and only thing that could change is code.
This is how I run my queue on worker:
clearml-agent daemon --queue cccg --docker
This is how I start the remote execution:task: clearml.Task = clearml.Task.init(project_name=config.PROJECT_NAME, task_name=config.TASK_NAME)
task.set_base_docker(docker_image=config.DOCKER_IMG,docker_arguments=["-v /mnt/data:/mnt/data",],)
# Disable automatic package managementtask.set_packages(packages=[])
task.execute_remotely(queue_name=config.QUEUE_NAME, exit_process=True)
The problem is that i see something installing in the container, and im not even sure where it happens and it crashes:
Hit:1 None bookworm InReleaseHit:2 None bookworm-updates InReleaseHit:3 None bookworm-security InReleaselibsm6 is already the newest version (2:1.2.3-1).libsm6 set to manually installed.libxext6 is already the newest version (2:1.3.4-1+b1).libxext6 set to manually installed.libxrender-dev is already the newest version (1:0.9.10-1.1).libxrender-dev set to manually installed.libglib2.0-0 is already the newest version (2.74.6-2+deb12u3).libglib2.0-0 set to manually installed.0 upgraded, 0 newly installed, 0 to remove and 1 not upgraded.Ignoring pip: markers 'python_version < "3.10"' don't match your environmentCollecting pip<22.3Using cached pip-22.2.2-py3-none-any.whl.metadata (4.2 kB)Using cached pip-22.2.2-py3-none-any.whl (2.0 MB)Installing collected packages: pipAttempting uninstall: pipFound existing installation: pip 24.2Uninstalling pip-24.2:Successfully uninstalled pip-24.2Successfully installed pip-22.2.2WARNING: Running pip as the 'root' user can result in broken permissions and conflicting behaviour with the system package manager, possibly rendering your system unusable.It is recommended to use a virtual environment instead: None . Use the --root-user-action option if you know what you are doing and want to suppress this warning.
[ notice ] A new release of pip is available: 22.2.2 -> 24.2[ notice ] To update, run: pip install --upgrade pipERROR: Exception:Traceback (most recent call last):File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 167, in exc_logging_wrapperstatus = run_func(*args)^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 247, in wrapperreturn func(self, options, args)^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/commands/install.py", line 315, in runsession = self.get_default_session(options)^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 98, in get_default_sessionself._session = self.enter_context(self._build_session(options))^^^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 125, in _build_sessionsession = PipSession(^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/network/session.py", line 343, in __init__self.headers["User-Agent"] = user_agent()^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/network/session.py", line 175, in user_agentsetuptools_dist = get_default_environment().get_distribution("setuptools")^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 180, in get_distributionreturn next(matches, None)^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 177, in <genexpr>for distribution in self.iter_all_distributions()^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/base.py", line 594, in iter_all_distributionsfor dist in self._iter_distributions():^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 168, in _iter_distributionsfor dist in finder.find_eggs(location):^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 136, in find_eggsyield from self._find_eggs_in_dir(location)File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 103, in _find_eggs_in_dirfrom pip._vendor.pkg_resources import find_distributionsFile "/usr/local/lib/python3.12/site-packages/pip/_vendor/pkg_resources/__init__.py", line 2164, in <module>register_finder(pkgutil.ImpImporter, find_on_path)^^^^^^^^^^^^^^^^^^^AttributeError: module 'pkgutil' has no attribute 'ImpImporter'. Did you mean: 'zipimporter'?Traceback (most recent call last):File "<frozen runpy>", line 198, in _run_module_as_mainFile "<frozen runpy>", line 88, in _run_codeFile "/usr/local/lib/python3.12/site-packages/pip/__main__.py", line 31, in <module>sys.exit(_main())^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/main.py", line 70, in mainreturn command.main(cmd_args)^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 101, in mainreturn self._main(args)^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/base_command.py", line 223, in _mainself.handle_pip_version_check(options)File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 179, in handle_pip_version_checksession = self._build_session(^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/cli/req_command.py", line 125, in _build_sessionsession = PipSession(^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/network/session.py", line 343, in __init__self.headers["User-Agent"] = user_agent()^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/network/session.py", line 175, in user_agentsetuptools_dist = get_default_environment().get_distribution("setuptools")^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 180, in get_distributionreturn next(matches, None)^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 177, in <genexpr>for distribution in self.iter_all_distributions()^^^^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/base.py", line 594, in iter_all_distributionsfor dist in self._iter_distributions():^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 168, in _iter_distributionsfor dist in finder.find_eggs(location):^^^^^^^^^^^^^^^^^^^^^^^^^^File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 136, in find_eggsyield from self._find_eggs_in_dir(location)File "/usr/local/lib/python3.12/site-packages/pip/_internal/metadata/importlib/_envs.py", line 103, in _find_eggs_in_dirfrom pip._vendor.pkg_resources import find_distributionsFile "/usr/local/lib/python3.12/site-packages/pip/_vendor/pkg_resources/__init__.py", line 2164, in <module>