Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi I Am Encountering Some Difficulties While Trying To Run The Examples Of The Clearml Documenation (E.G.

Hi i am encountering some difficulties while trying to run the examples of the ClearML Documenation (e.g. https://clear.ml/docs/latest/docs/guides/pipeline/pipeline_controller/ ) using my own local Workstation as an agent. Every time i try to start the pipeline the execution stops with following error message:
Warning: could not locate requested Python version 3.9, reverting to version 3.9
clearml_agent: ERROR: 'utf-8' codec can't decode byte 0xfc in position 38: invalid start byte
Does anybody know the root and or the solution for this behaviour?

  
  
Posted one year ago
Votes Newest

Answers 8


Hi FreshBat85 ,

Does this happen with any of the other examples? What version of agent are you running and what OS are you on?

  
  
Posted one year ago

and here is the full log:
` 2022-04-13 10:02:21
task 9def34949d4c4530af9805f49afeed89 pulled from 2fd2e1c853824d4ca955ab38662a205e by worker DESKTOP-892UKB3:0
2022-04-13 10:02:30
Current configuration (clearml_agent v1.2.2, location: C:/Users/natte/AppData/Local/Temp/.clearml_agent.v33hbl_p.cfg):

agent.worker_id = DESKTOP-892UKB3:0
agent.worker_name = DESKTOP-892UKB3
agent.force_git_ssh_protocol = false
agent.python_binary =
agent.package_manager.type = pip
agent.package_manager.pip_version = <20.2
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.torch_nightly = false
agent.venvs_dir = C:/Users/natte/.clearml/venvs-builds
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.vcs_cache.enabled = true
agent.vcs_cache.path = C:/Users/natte/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = C:/Users/natte/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = C:/Users/natte/.clearml/pip-cache
agent.docker_apt_cache = C:/Users/natte/.clearml/apt-cache
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = /root/.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = /root/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script =
agent.git_user = flnat
agent.extra_docker_shell_script.0 = apt-get install -y locales
agent.default_python = 3.9
agent.cuda_version = 115
agent.cudnn_version = 0
api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.api_server =
api.web_server =
api.files_server =
api.credentials.access_key = EI03I6WG456W1M5HK9SM
api.host =
sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.aws.s3.key =
sdk.aws.s3.region =
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri =
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false
clearml_agent: Warning: Working dir "models\Simple Pipeline" contains backslashes. All path separators must be forward slashes.
Executing task id [9def34949d4c4530af9805f49afeed89]:
repository =
branch = master
version_num = eca6bbee4941aa71e3d1f9af5a18321e0f48a2ae
tag =
docker_cmd =
entry_point = step1_dataset_artifact.py
working_dir = models\Simple Pipeline
Warning: could not locate requested Python version 3.9, reverting to version 3.9
clearml_agent: ERROR: 'utf-8' codec can't decode byte 0xfc in position 38: invalid start byte
2022-04-13 10:02:30
Process failed, exit code 1 `

  
  
Posted one year ago

Yes this happens with all examples i'm trying to run on this particular machine. The Machine itself runs on Windows 10 and i'm using version 1.2.2 of the agent

  
  
Posted one year ago

Hi AgitatedDove14 , sorry for my late reply. Yes I was able to solve the issue with it

  
  
Posted one year ago

Hi FreshBat85
clearml_agent: ERROR: 'utf-8' codec can't decode byte 0xfc in position 38: invalid start byteThis is a notorious issue with python and UTF-8/Unicode support.
Any chance there is "unicode"/utf8 code in the uncommitted changes section ?

BTW you can set an environment variable before spinning the agent, telling it always to use UTF8
set PYTHONUTF8=1

  
  
Posted one year ago

Also can you provide the full log for better context?

  
  
Posted one year ago

Update us if it solved the issue (for increased visibility)

  
  
Posted one year ago

Hi AgitatedDove14 , yes this quite likely. Thank you for your recommendation

  
  
Posted one year ago
469 Views
8 Answers
one year ago
one year ago
Tags