Hi FreshBat85 ,
Does this happen with any of the other examples? What version of agent are you running and what OS are you on?
Update us if it solved the issue (for increased visibility)
Hi AgitatedDove14 , sorry for my late reply. Yes I was able to solve the issue with it
and here is the full log:
` 2022-04-13 10:02:21
task 9def34949d4c4530af9805f49afeed89 pulled from 2fd2e1c853824d4ca955ab38662a205e by worker DESKTOP-892UKB3:0
2022-04-13 10:02:30
Current configuration (clearml_agent v1.2.2, location: C:/Users/natte/AppData/Local/Temp/.clearml_agent.v33hbl_p.cfg):
agent.worker_id = DESKTOP-892UKB3:0
agent.worker_name = DESKTOP-892UKB3
agent.force_git_ssh_protocol = false
agent.python_binary =
agent.package_manager.type = pip
agent.package_manager.pip_version = <20.2
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.torch_nightly = false
agent.venvs_dir = C:/Users/natte/.clearml/venvs-builds
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.vcs_cache.enabled = true
agent.vcs_cache.path = C:/Users/natte/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = C:/Users/natte/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = C:/Users/natte/.clearml/pip-cache
agent.docker_apt_cache = C:/Users/natte/.clearml/apt-cache
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = /root/.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = /root/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script =
agent.git_user = flnat
agent.extra_docker_shell_script.0 = apt-get install -y locales
agent.default_python = 3.9
agent.cuda_version = 115
agent.cudnn_version = 0
api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.api_server =
api.web_server =
api.files_server =
api.credentials.access_key = EI03I6WG456W1M5HK9SM
api.host =
sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.aws.s3.key =
sdk.aws.s3.region =
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri =
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false
clearml_agent: Warning: Working dir "models\Simple Pipeline" contains backslashes. All path separators must be forward slashes.
Executing task id [9def34949d4c4530af9805f49afeed89]:
repository =
branch = master
version_num = eca6bbee4941aa71e3d1f9af5a18321e0f48a2ae
tag =
docker_cmd =
entry_point = step1_dataset_artifact.py
working_dir = models\Simple Pipeline
Warning: could not locate requested Python version 3.9, reverting to version 3.9
clearml_agent: ERROR: 'utf-8' codec can't decode byte 0xfc in position 38: invalid start byte
2022-04-13 10:02:30
Process failed, exit code 1 `
Hi AgitatedDove14 , yes this quite likely. Thank you for your recommendation
Also can you provide the full log for better context?
Yes this happens with all examples i'm trying to run on this particular machine. The Machine itself runs on Windows 10 and i'm using version 1.2.2 of the agent
Hi FreshBat85clearml_agent: ERROR: 'utf-8' codec can't decode byte 0xfc in position 38: invalid start byteThis is a notorious issue with python and UTF-8/Unicode support.
Any chance there is "unicode"/utf8 code in the uncommitted changes section ?
BTW you can set an environment variable before spinning the agent, telling it always to use UTF8set PYTHONUTF8=1