Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All, How Can I Change Default Python Version For Conda Env Creating In Clearml-Agent With Conda Mode? I’Ve Set Python 3.7 Path In Agent.Python_Binary, But Clearml Use Python 3.6, That Is Assigned As System Python. Also I’Ve Tried To Set Agent.Ignore_Re

Hi all, how can I change default python version for conda env creating in clearml-agent with conda mode?
I’ve set python 3.7 path in agent.python_binary, but clearml use python 3.6, that is assigned as system python. Also I’ve tried to set agent.ignore_requested_python_version = false, it doesn’t help.

Task execution logs:
sdk.network.iteration.retry_backoff_factor_sec = 10 sdk.aws.s3.key = sdk.aws.s3.region = sdk.aws.s3.use_credentials_chain = false sdk.aws.boto3.pool_connections = 512 sdk.aws.boto3.max_multipart_concurrency = 16 sdk.log.null_log_propagate = false sdk.log.task_log_buffer_capacity = 66 sdk.log.disable_urllib3_info = true sdk.development.task_reuse_time_window_in_hours = 72.0 sdk.development.vcs_repo_detect_async = true sdk.development.store_uncommitted_code_diff = true sdk.development.support_stopping = true sdk.development.default_output_uri = sdk.development.force_analyze_entire_repo = false sdk.development.suppress_update_message = false sdk.development.detect_with_pip_freeze = false sdk.development.worker.report_period_sec = 2 sdk.development.worker.ping_period_sec = 30 sdk.development.worker.log_stdout = true sdk.development.worker.report_global_mem_used = false sdk.development.worker.console_cr_flush_period = 10 sdk.apply_environment = false sdk.apply_files = false agent.worker_id = v010-0:gpuGPU-039b7a47-01d8-9fcc-136c-50ca7ce0c59a agent.worker_name = v010-0 agent.force_git_ssh_protocol = true agent.python_binary = /home/jovyan/.imgenv-v010-0/bin/python agent.package_manager.type = conda agent.package_manager.pip_version.0 = <20.2 ; python_version < '3.10' agent.package_manager.pip_version.1 = <22.3 ; python_version >\= '3.10' agent.package_manager.system_site_packages = false agent.package_manager.force_upgrade = false agent.package_manager.conda_channels.0 = pytorch agent.package_manager.conda_channels.1 = conda-forge agent.package_manager.conda_channels.2 = defaults agent.package_manager.priority_optional_packages.0 = pygobject agent.package_manager.torch_nightly = false agent.venvs_dir = /home/jovyan/.clearml/venvs-builds agent.venvs_cache.max_entries = 10 agent.venvs_cache.free_space_threshold_gb = 2.0 agent.venvs_cache.path = ~/.clearml/venvs-cache agent.vcs_cache.enabled = true agent.vcs_cache.path = /home/jovyan/.clearml/vcs-cache agent.venv_update.enabled = false agent.pip_download_cache.enabled = true agent.pip_download_cache.path = /home/jovyan/.clearml/pip-download-cache agent.translate_ssh = true agent.reload_config = false agent.docker_pip_cache = /home/jovyan/.clearml/pip-cache agent.docker_apt_cache = /home/jovyan/.clearml/apt-cache agent.docker_force_pull = false agent.default_docker.image = python:3.7.13-bullseye agent.enable_task_env = false agent.hide_docker_command_env_vars.enabled = true agent.hide_docker_command_env_vars.parse_embedded_urls = true agent.abort_callback_max_timeout = 1800 agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives agent.docker_internal_mounts.ssh_folder = ~/.ssh agent.docker_internal_mounts.ssh_ro_folder = /.ssh agent.docker_internal_mounts.pip_cache = /root/.cache/pip agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache agent.docker_internal_mounts.venv_build = ~/.clearml/venvs-builds agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache agent.apply_environment = true agent.apply_files = true agent.custom_build_script = agent.disable_task_docker_override = false agent.extra_docker_shell_script.0 = chown -R root:root /root/.ssh agent.ignore_requested_python_version = false agent.default_python = 3.7 agent.cuda_version = cu110 agent.cudnn_version = 80 Executing task id [df1e4f3d171f475ba7dafa2b74b1ac62]: repository = branch = mybranch version_num = 591c99627fe7810792f2aeb371c264992aa6025b tag = docker_cmd = entry_point = run_tabular.py working_dir = experiments Executing Conda: /home/user/conda/bin/conda env remove -p /home/jovyan/.clearml/venvs-builds/3.6 --quiet --json 2022-12-12 02:29:05 Remove all packages in environment /home/jovyan/.clearml/venvs-builds/3.6: Executing Conda: /home/user/conda/bin/conda create --yes --mkdir --prefix /home/jovyan/.clearml/venvs-builds/3.6 python=3.6

  
  
Posted one year ago
Votes Newest

Answers 4


Hi EnviousPanda91 , do you have Python 3.7 installed on the machine/image you're running?

  
  
Posted one year ago

task log
` task ca3ab0ce39aa436f9e656fff378a2c25 pulled from c39519fcfb3f4353808fd266d6100795 by worker v012-0:gpuGPU-0929fd0f-eff1-91f1-854e-9874599660c3
2022-12-12 16:32:21
Current configuration (clearml_agent v1.5.1, location: /tmp/.clearml_agent.guezjnez.cfg):

api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.web_server =
api.api_server =
api.files_server =
api.credentials.access_key = ZGUPR1PKVXYK1RUZWXY4
api.host =
sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.aws.s3.key =
sdk.aws.s3.region =
sdk.aws.s3.use_credentials_chain = false
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri =
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false
sdk.development.worker.console_cr_flush_period = 10
sdk.apply_environment = false
sdk.apply_files = false
agent.worker_id = v012-0:gpuGPU-0929fd0f-eff1-91f1-854e-9874599660c3
agent.worker_name = v012-0
agent.force_git_ssh_protocol = true
agent.python_binary = /usr/bin/python3.8
agent.package_manager.type = conda
agent.package_manager.pip_version.0 = <20.2 ; python_version < '3.10'
agent.package_manager.pip_version.1 = <22.3 ; python_version >= '3.10'
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.priority_optional_packages.0 = pygobject
agent.package_manager.torch_nightly = false
agent.venvs_dir = /home/jovyan/.clearml/venvs-builds
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.venvs_cache.path = ~/.clearml/venvs-cache
agent.vcs_cache.enabled = true
agent.vcs_cache.path = /home/jovyan/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = /home/jovyan/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = /home/jovyan/.clearml/pip-cache
agent.docker_apt_cache = /home/jovyan/.clearml/apt-cache
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.abort_callback_max_timeout = 1800
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = ~/.ssh
agent.docker_internal_mounts.ssh_ro_folder = /.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = ~/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script =
agent.disable_task_docker_override = false
agent.extra_docker_shell_script.0 = chown -R root:root /root/.ssh
agent.ignore_requested_python_version = false
agent.default_python = 3.8
agent.cuda_version = cu110
agent.cudnn_version = 80
Executing task id [ca3ab0ce39aa436f9e656fff378a2c25]:
repository =
branch = mybranch
version_num = 591c99627fe7810792f2aeb371c264992aa6025b
tag =
docker_cmd =
entry_point = run_tabular.py
working_dir = experiments
Executing Conda: /home/user/conda/bin/conda env remove -p /home/jovyan/.clearml/venvs-builds/3.6 --quiet --json
Executing Conda: /home/user/conda/bin/conda create --yes --mkdir --prefix /home/jovyan/.clearml/venvs-builds/3.6 python=3.6 `

  
  
Posted one year ago

SuccessfulKoala55 yes, I have /usr/bin/python3.8, but it doesn’t help if I set it in agent.python_binary. python3.8 set as alternative #1 for python. but conda for some reason creating env with python3.6...

Executing Conda: /home/user/conda/bin/conda env remove -p /home/jovyan/.clearml/venvs-builds/3.6 --quiet --json

  
  
Posted one year ago

Wait, what python version is the Conda installed in your system?

  
  
Posted one year ago
716 Views
4 Answers
one year ago
one year ago
Tags