well, also, now, my runs are showing off problems as well:
@<1523701070390366208:profile|CostlyOstrich36>
let us know if anything more is needed :
ClearML results page: None
2023-03-09 16:53:43
2023-03-09 16:53:43,981 - clearml.Task - INFO - Waiting for repository detection and full package requirement analysis
2023-03-09 16:53:46
ClearML Monitor: GPU monitoring failed getting GPU reading, switching off GPU monitoring
2023-03-09 16:53:50
2023-03-09 16:53:50,515 - clearml.Task - INFO - Finished repository detection and package analysis
2023-03-09 16:53:57
task 19decfa3a0f3421099457a9b622d9e8b pulled from b5aedca41729414e9b44f201d5fa4970 by worker cpu-clearml-worker1:1
2023-03-09 16:54:02
Process failed, exit code 1
2023-03-09 16:54:02
Current configuration (clearml_agent v1.5.1, location: /tmp/.clearml_agent.kjkfek7b.cfg):
sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.aws.s3.key =
sdk.aws.s3.region =
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri =
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false
api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.api_server = None
api.web_server = None
api.files_server = None
api.credentials.access_key = 7GO3OG1H7FAWO89N0A2D
api.host = None
agent.worker_id = cpu-clearml-worker1:1
agent.worker_name = cpu-clearml-worker1
agent.force_git_ssh_protocol = false
agent.python_binary =
agent.package_manager.type = pip
agent.package_manager.pip_version.0 = <20.2 ; python_version < '3.10'
agent.package_manager.pip_version.1 = <22.3 ; python_version >= '3.10'
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.priority_optional_packages.0 = pygobject
agent.package_manager.torch_nightly = false
agent.venvs_dir = /home/azureuser/.clearml/venvs-builds.1
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.venvs_cache.path = ~/.clearml/venvs-cache
agent.vcs_cache.enabled = true
agent.vcs_cache.path = /home/azureuser/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = /home/azureuser/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = /home/azureuser/.clearml/pip-cache
agent.docker_apt_cache = /home/azureuser/.clearml/apt-cache.1
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.abort_callback_max_timeout = 1800
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = ~/.ssh
agent.docker_internal_mounts.ssh_ro_folder = /.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = ~/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script =
agent.disable_task_docker_override = false
agent.git_user =
agent.default_python = 3.8
agent.cuda_version = 110
agent.cudnn_version = 0
Executing task id [19decfa3a0f3421099457a9b622d9e8b]:
repository = None
branch = clearml-integration
version_num = 3df0b5377559a6bc29685216a4e8f4f254dfc8f9
tag =
docker_cmd =
entry_point = insert_missing_rows_based_on_stock.py
working_dir = mlops/tasks/preprocessing
Python executable with version '3.9' requested by the Task, not found in path, using '/anaconda/envs/azureml_py38/bin/python3' (v3.8.10) instead
::: Using Cached environment /home/azureuser/.clearml/venvs-cache/1c3c42b9c1baa9db9d636c2105855e40.f3d970cb3143d415c39b16d59922f547 :::
cloning: None
fatal: could not read Username for ' None ': terminal prompts disabled
Repository cloning failed: Command '['clone', ' None ', '/home/azureuser/.clearml/vcs-cache/palmers.git.0f054236d429dc82f1e35dd0eff02ade/palmers.git', '--quiet', '--recursive']' returned non-zero exit status 128.
clearml_agent: ERROR: Failed cloning repository.
- Make sure you pushed the requested commit:
(repository=' None ', branch='clearml-integration', commit_id='3df0b5377559a6bc29685216a4e8f4f254dfc8f9', tag='', docker_cmd=None, entry_point='insert_missing_rows_based_on_stock.py', working_dir='mlops/tasks/preprocessing') - Check if remote-worker has valid credentials [see worker configuration file]
Hey joey, i configured ssh locally for my pc as well, and now it works.
are you guys planning in the future a feature which will allow me to specify the connection type, without relation to what i am running locally?
What do you mean by connection type? SSH as opposed to HTTPS?
The repository is None and the URL does not indicate the ssh protocol, so the agent attempt to clone using user/pass credentials (which are not provided)
why doesn't it try to use ssh as default? the clearml.conf doesn't contain user name and password
Hi @<1544853695869489152:profile|NonchalantOx99> , can you please add the full log?
ok, thanks jake
what will be the fastest fix for it?
It uses whatever was recorded on the task (when the user ran it locally) - that's when the repository URL was recorded and that's what it tries to use
If this is the failure, are you sure you configured ssh correctly?