Hello, I Have The Following Scenario:

Answered

Hello,

I have the following scenario:

I am running a clearml-agent on a Windows machine;
To run on the agents, I am using virtual envs;
In the file that I am linking with Task.init, I am adding other libraries that are not on the official pip server, so I am using the following command:- Task.add_requirements(package_name=" None ")
When the agent tries to execute this, it generates an error:

clearml_agent: ERROR: Could not install task requirements!
[WinError 123] The filename, directory name, or volume label syntax is incorrect: '\C:\Users\my_name\.clearml\pip-download-cache\cu0\my_custom_package.whl'

This is because on Windows, the two backslashes at the beginning of the path make the file path invalid.

I got the source code of clearml-agent and debugged it until I found where the error was happening. It happens in this method:

None

def validate_local_file_ref(self):
        # if local file does not exist, remove the reference to it
        if self.vcs or self.editable or self.path or not self.local_file or not self.name or \
                not self.uri or not self.uri.startswith("file://"):
            return
        local_path = Path(self.uri[len("file://"):])
        if not local_path.exists():
            local_path = Path(unquote(self.uri)[len("file://"):])
            if not local_path.exists():
                line = self.line
                if self.remove_local_file_ref():
                    # print warning
                    logging.getLogger(__name__).warning(
                        'Local file not found [{}], references removed'.format(line))

If I change file:// to file:/// (adding one backslashe) the routine can convert the path to a valid Windows path and everything works.

My doubt is:

Am I doing something wrong?
Is this a bug?
Is there another way to do this?
Sorry for the long text 😅

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DistressedCoyote60
				
					0
					 × 1

Votes Newest

Answers 10

Your suspicions were correct. Disabling this setting worked.

Thank you so much for your help. I really appreciate it.

P.S.: I also cleared the caches of the venv ( agent.venvs_cache.path ).

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DistressedCoyote60
				
					0
					 × 1

@<1523701205467926528:profile|AgitatedDove14> sure, I'll do that this weekend.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DistressedCoyote60
				
					0
					 × 1

@<1564422644407734272:profile|DistressedCoyote60> could you open a GitHub issue on it in clearml-agent, just so we know of the problem and fix it for next version ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

See the log:

Collecting keras-contrib==2.0.8
  File was already downloaded c:\users\mateus.ca\.clearml\pip-download-cache\cu0\keras_contrib-2.0.8-py3-none-any.whl

so it did download it, but it failed to pass it correctly ?!
Can you try with clearml-agent==1.5.3rc2 ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Internally it's taking this URL and downloading the file, building the path with

file:///

(edited)

This part is confusing, http link should work, how are you ending up with file:// links ? do you want to provide the full agent log with the error ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Same error with 1.5.3rc2

1683330869711 Mateus-DSV:0 INFO task a7b24d0c0f374a1d8df7019985ef6b28 pulled from 2ab43b3b9cc5449ca4701ea40fa791de by worker Mateus-DSV:0

1683330874980 Mateus-DSV:0 DEBUG Current configuration (clearml_agent v1.5.3rc2, location: C:/Users/MATEUS~1.CAS/AppData/Local/Temp/.clearml_agent.4s_2objx.cfg):
----------------------
agent.worker_id = Mateus-DSV:0
agent.worker_name = Mateus-DSV
agent.force_git_ssh_protocol = false
agent.python_binary = 
agent.package_manager.type = pip
agent.package_manager.pip_version.0 = <20.2 ; python_version < '3.10'
agent.package_manager.pip_version.1 = <22.3 ; python_version >\= '3.10'
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.priority_optional_packages.0 = pygobject
agent.package_manager.torch_nightly = false
agent.package_manager.poetry_files_from_repo_working_dir = false
agent.venvs_dir = C:/Users/mateus.ca/.clearml/venvs-builds
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.venvs_cache.path = ~/.clearml/venvs-cache
agent.vcs_cache.enabled = true
agent.vcs_cache.path = C:/Users/mateus.ca/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = C:/Users/mateus.ca/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = C:/Users/mateus.ca/.clearml/pip-cache
agent.docker_apt_cache = C:/Users/mateus.ca/.clearml/apt-cache
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.abort_callback_max_timeout = 1800
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = ~/.ssh
agent.docker_internal_mounts.ssh_ro_folder = /.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = ~/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script = 
agent.disable_task_docker_override = false
agent.git_user = 
agent.default_python = 3.7
agent.cuda_version = 0
agent.cudnn_version = 0
api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.api_server =


api.web_server =


api.files_server =


api.credentials.access_key = XXXXXXXXXXXXXXXXXXX
api.host =


sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.aws.s3.key = 
sdk.aws.s3.region = 
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri = 
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false

Executing task id [a7b24d0c0f374a1d8df7019985ef6b28]:
repository = 
branch = 
version_num = 
tag = 
docker_cmd = 
entry_point = script.py
working_dir = .

created virtual environment CPython3.7.9.final.0-64 in 716ms
  creator CPython3Windows(dest=C:\Users\mateus.ca\.clearml\venvs-builds\3.7, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=C:\Users\mateus.ca\AppData\Local\pypa\virtualenv)
    added seed packages: pip==23.1.2, setuptools==67.7.2, wheel==0.40.0
  activators BashActivator,BatchActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator





1683330879943 Mateus-DSV:0 DEBUG Ignoring pip: markers 'python_version >= "3.10"' don't match your environment
Collecting pip<20.2
  Using cached pip-20.1.1-py2.py3-none-any.whl (1.5 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 23.1.2
    Uninstalling pip-23.1.2:
      Successfully uninstalled pip-23.1.2
Successfully installed pip-20.1.1
Collecting Cython
  Using cached Cython-0.29.34-py2.py3-none-any.whl (988 kB)
Installing collected packages: Cython

1683330885020 Mateus-DSV:0 DEBUG Successfully installed Cython-0.29.34
Collecting keras-contrib==2.0.8
  File was already downloaded c:\users\mateus.ca\.clearml\pip-download-cache\cu0\keras_contrib-2.0.8-py3-none-any.whl
Successfully downloaded keras-contrib
Collecting boto3==1.17.70
  Using cached boto3-1.17.70-py2.py3-none-any.whl (131 kB)
Processing c:\users\mateus.ca\.clearml\pip-download-cache\cu0\keras_contrib-2.0.8-py3-none-any.whl
Collecting clearml==1.10.3
  Using cached clearml-1.10.3-py2.py3-none-any.whl (1.1 MB)
Collecting s3transfer<0.5.0,>=0.4.0
  Using cached s3transfer-0.4.2-py2.py3-none-any.whl (79 kB)
Collecting jmespath<1.0.0,>=0.7.1
  Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB)
Collecting botocore<1.21.0,>=1.20.70
  Using cached botocore-1.20.112-py2.py3-none-any.whl (7.7 MB)

1683330890117 Mateus-DSV:0 DEBUG Collecting keras
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting attrs>=18.0
  Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting pyparsing>=2.0.3
  Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting PyYAML>=3.12
  Using cached PyYAML-6.0-cp37-cp37m-win_amd64.whl (153 kB)
Collecting requests>=2.20.0
  Using cached requests-2.30.0-py3-none-any.whl (62 kB)
Collecting jsonschema>=2.6.0
  Using cached jsonschema-4.17.3-py3-none-any.whl (90 kB)
Collecting python-dateutil>=2.6.1
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting six>=1.13.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting psutil>=3.4.2
  Using cached psutil-5.9.5-cp36-abi3-win_amd64.whl (255 kB)
Collecting Pillow>=4.1.1
  Using cached Pillow-9.5.0-cp37-cp37m-win_amd64.whl (2.5 MB)
Collecting urllib3>=1.21.1
  Using cached urllib3-2.0.2-py3-none-any.whl (123 kB)
Collecting pyjwt<2.5.0,>=2.4.0; python_version > "3.5"
  Using cached PyJWT-2.4.0-py3-none-any.whl (18 kB)
Collecting numpy>=1.10
  Using cached numpy-1.21.6-cp37-cp37m-win_amd64.whl (14.0 MB)
Collecting furl>=2.0.0
  Using cached furl-2.1.3-py2.py3-none-any.whl (20 kB)

1683330895199 Mateus-DSV:0 DEBUG Collecting pathlib2>=2.3.0
  Using cached pathlib2-2.3.7.post1-py2.py3-none-any.whl (18 kB)
Collecting importlib-metadata; python_version < "3.8"
  Using cached importlib_metadata-6.6.0-py3-none-any.whl (22 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting charset-normalizer<4,>=2
  Using cached charset_normalizer-3.1.0-cp37-cp37m-win_amd64.whl (94 kB)
Collecting typing-extensions; python_version < "3.8"
  Using cached typing_extensions-4.5.0-py3-none-any.whl (27 kB)
Collecting importlib-resources>=1.4.0; python_version < "3.9"
  Using cached importlib_resources-5.12.0-py3-none-any.whl (36 kB)
Collecting pkgutil-resolve-name>=1.3.10; python_version < "3.9"
  Using cached pkgutil_resolve_name-1.3.10-py3-none-any.whl (4.7 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
  Using cached pyrsistent-0.19.3-cp37-cp37m-win_amd64.whl (62 kB)
Collecting orderedmultidict>=1.0.1
  Using cached orderedmultidict-1.0.1-py2.py3-none-any.whl (11 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
ERROR: botocore 1.20.112 has requirement urllib3<1.27,>=1.25.4, but you'll have urllib3 2.0.2 which is incompatible.
Installing collected packages: six, python-dateutil, jmespath, urllib3, botocore, s3transfer, boto3, keras, keras-contrib, zipp, typing-extensions, importlib-metadata, attrs, pyparsing, PyYAML, certifi, idna, charset-normalizer, requests, importlib-resources, pkgutil-resolve-name, pyrsistent, jsonschema, psutil, Pillow, pyjwt, numpy, orderedmultidict, furl, pathlib2, clearml

1683330915312 Mateus-DSV:0 DEBUG Successfully installed Pillow-9.5.0 PyYAML-6.0 attrs-23.1.0 boto3-1.17.70 botocore-1.20.112 certifi-2022.12.7 charset-normalizer-3.1.0 clearml-1.10.3 furl-2.1.3 idna-3.4 importlib-metadata-6.6.0 importlib-resources-5.12.0 jmespath-0.10.0 jsonschema-4.17.3 keras-2.11.0 keras-contrib-2.0.8 numpy-1.21.6 orderedmultidict-1.0.1 pathlib2-2.3.7.post1 pkgutil-resolve-name-1.3.10 psutil-5.9.5 pyjwt-2.4.0 pyparsing-3.0.9 pyrsistent-0.19.3 python-dateutil-2.8.2 requests-2.30.0 s3transfer-0.4.2 six-1.16.0 typing-extensions-4.5.0 urllib3-2.0.2 zipp-3.15.0

clearml_agent: ERROR: Could not install task requirements!
[WinError 123] A sintaxe do nome do arquivo, do nome do diret rio ou do r tulo do volume est  incorreta: '\\C:\\Users\\mateus.ca\\.clearml\\pip-download-cache\\cu0\\keras_contrib-2.0.8-py3-none-any.whl'


1683330915366 Mateus-DSV:0 DEBUG Process failed, exit code 1

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DistressedCoyote60
				
					0
					 × 1

Hi @<1564422644407734272:profile|DistressedCoyote60>
I'm a bit confused, are you registering the wheels with https:// link or with file:/// links (i mean in your code) ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Sure,

My task:

from clearml import Logger, OutputModel, Task

Task.add_requirements(package_name="

")

task = Task.init(
    project_name="test_project",
    task_name="training",
    reuse_last_task_id=False,
    tags=["clearml_test"],
    output_uri=True,
    auto_connect_frameworks=False,
)

import keras_contrib

print(keras_contrib.__version__)

clearml-agent log:

1683324000711 Mateus-DSV:0 INFO task e874d28b54cf489fa285f05c26741462 pulled from 2ab43b3b9cc5449ca4701ea40fa791de by worker Mateus-DSV:0

1683324005958 Mateus-DSV:0 DEBUG Current configuration (clearml_agent v1.5.2, location: C:/Users/MATEUS~1.CAS/AppData/Local/Temp/.clearml_agent.6sd92f73.cfg):
----------------------
agent.worker_id = Mateus-DSV:0
agent.worker_name = Mateus-DSV
agent.force_git_ssh_protocol = false
agent.python_binary = 
agent.package_manager.type = pip
agent.package_manager.pip_version.0 = <20.2 ; python_version < '3.10'
agent.package_manager.pip_version.1 = <22.3 ; python_version >\= '3.10'
agent.package_manager.system_site_packages = false
agent.package_manager.force_upgrade = false
agent.package_manager.conda_channels.0 = pytorch
agent.package_manager.conda_channels.1 = conda-forge
agent.package_manager.conda_channels.2 = defaults
agent.package_manager.priority_optional_packages.0 = pygobject
agent.package_manager.torch_nightly = false
agent.package_manager.poetry_files_from_repo_working_dir = false
agent.venvs_dir = C:/Users/mateus.ca/.clearml/venvs-builds
agent.venvs_cache.max_entries = 10
agent.venvs_cache.free_space_threshold_gb = 2.0
agent.venvs_cache.path = ~/.clearml/venvs-cache
agent.vcs_cache.enabled = true
agent.vcs_cache.path = C:/Users/mateus.ca/.clearml/vcs-cache
agent.venv_update.enabled = false
agent.pip_download_cache.enabled = true
agent.pip_download_cache.path = C:/Users/mateus.ca/.clearml/pip-download-cache
agent.translate_ssh = true
agent.reload_config = false
agent.docker_pip_cache = C:/Users/mateus.ca/.clearml/pip-cache
agent.docker_apt_cache = C:/Users/mateus.ca/.clearml/apt-cache
agent.docker_force_pull = false
agent.default_docker.image = nvidia/cuda:10.2-cudnn7-runtime-ubuntu18.04
agent.enable_task_env = false
agent.hide_docker_command_env_vars.enabled = true
agent.hide_docker_command_env_vars.parse_embedded_urls = true
agent.abort_callback_max_timeout = 1800
agent.docker_internal_mounts.sdk_cache = /clearml_agent_cache
agent.docker_internal_mounts.apt_cache = /var/cache/apt/archives
agent.docker_internal_mounts.ssh_folder = ~/.ssh
agent.docker_internal_mounts.ssh_ro_folder = /.ssh
agent.docker_internal_mounts.pip_cache = /root/.cache/pip
agent.docker_internal_mounts.poetry_cache = /root/.cache/pypoetry
agent.docker_internal_mounts.vcs_cache = /root/.clearml/vcs-cache
agent.docker_internal_mounts.venv_build = ~/.clearml/venvs-builds
agent.docker_internal_mounts.pip_download = /root/.clearml/pip-download-cache
agent.apply_environment = true
agent.apply_files = true
agent.custom_build_script = 
agent.disable_task_docker_override = false
agent.git_user = 
agent.default_python = 3.7
agent.cuda_version = 0
agent.cudnn_version = 0
api.version = 1.5
api.verify_certificate = true
api.default_version = 1.5
api.http.max_req_size = 15728640
api.http.retries.total = 240
api.http.retries.connect = 240
api.http.retries.read = 240
api.http.retries.redirect = 240
api.http.retries.status = 240
api.http.retries.backoff_factor = 1.0
api.http.retries.backoff_max = 120.0
api.http.wait_on_maintenance_forever = true
api.http.pool_maxsize = 512
api.http.pool_connections = 512
api.api_server =


api.web_server =


api.files_server =


api.credentials.access_key = XXXXXXXXXXXXXXXXXX
api.host =


sdk.storage.cache.default_base_dir = ~/.clearml/cache
sdk.storage.cache.size.min_free_bytes = 10GB
sdk.storage.direct_access.0.url = file://*
sdk.metrics.file_history_size = 100
sdk.metrics.matplotlib_untitled_history_size = 100
sdk.metrics.images.format = JPEG
sdk.metrics.images.quality = 87
sdk.metrics.images.subsampling = 0
sdk.metrics.tensorboard_single_series_per_graph = false
sdk.network.metrics.file_upload_threads = 4
sdk.network.metrics.file_upload_starvation_warning_sec = 120
sdk.network.iteration.max_retries_on_server_error = 5
sdk.network.iteration.retry_backoff_factor_sec = 10
sdk.aws.s3.key = 
sdk.aws.s3.region = 
sdk.aws.boto3.pool_connections = 512
sdk.aws.boto3.max_multipart_concurrency = 16
sdk.log.null_log_propagate = false
sdk.log.task_log_buffer_capacity = 66
sdk.log.disable_urllib3_info = true
sdk.development.task_reuse_time_window_in_hours = 72.0
sdk.development.vcs_repo_detect_async = true
sdk.development.store_uncommitted_code_diff = true
sdk.development.support_stopping = true
sdk.development.default_output_uri = 
sdk.development.force_analyze_entire_repo = false
sdk.development.suppress_update_message = false
sdk.development.detect_with_pip_freeze = false
sdk.development.worker.report_period_sec = 2
sdk.development.worker.ping_period_sec = 30
sdk.development.worker.log_stdout = true
sdk.development.worker.report_global_mem_used = false

Executing task id [e874d28b54cf489fa285f05c26741462]:
repository = 
branch = 
version_num = 
tag = 
docker_cmd = 
entry_point = script.py
working_dir = .


1683324010936 Mateus-DSV:0 DEBUG created virtual environment CPython3.7.9.final.0-64 in 1319ms
  creator CPython3Windows(dest=C:\Users\mateus.ca\.clearml\venvs-builds\3.7, clear=False, no_vcs_ignore=False, global=False)
  seeder FromAppData(download=False, pip=bundle, setuptools=bundle, wheel=bundle, via=copy, app_data_dir=C:\Users\mateus.ca\AppData\Local\pypa\virtualenv)
    added seed packages: pip==23.1.2, setuptools==67.7.2, wheel==0.40.0
  activators BashActivator,BatchActivator,FishActivator,NushellActivator,PowerShellActivator,PythonActivator

1683324016023 Mateus-DSV:0 DEBUG 



Ignoring pip: markers 'python_version >= "3.10"' don't match your environment
Collecting pip<20.2
  Using cached pip-20.1.1-py2.py3-none-any.whl (1.5 MB)
Installing collected packages: pip
  Attempting uninstall: pip
    Found existing installation: pip 23.1.2
    Uninstalling pip-23.1.2:
      Successfully uninstalled pip-23.1.2
Successfully installed pip-20.1.1

1683324021105 Mateus-DSV:0 DEBUG Collecting Cython
  Using cached Cython-0.29.34-py2.py3-none-any.whl (988 kB)
Installing collected packages: Cython
Successfully installed Cython-0.29.34
Collecting keras-contrib==2.0.8
  File was already downloaded c:\users\mateus.ca\.clearml\pip-download-cache\cu0\keras_contrib-2.0.8-py3-none-any.whl
Successfully downloaded keras-contrib
Collecting boto3==1.17.70
  Using cached boto3-1.17.70-py2.py3-none-any.whl (131 kB)
Processing c:\users\mateus.ca\.clearml\pip-download-cache\cu0\keras_contrib-2.0.8-py3-none-any.whl
Collecting clearml==1.10.3
  Using cached clearml-1.10.3-py2.py3-none-any.whl (1.1 MB)
Collecting jmespath<1.0.0,>=0.7.1
  Using cached jmespath-0.10.0-py2.py3-none-any.whl (24 kB)

1683324026209 Mateus-DSV:0 DEBUG Collecting botocore<1.21.0,>=1.20.70
  Using cached botocore-1.20.112-py2.py3-none-any.whl (7.7 MB)
Collecting s3transfer<0.5.0,>=0.4.0
  Using cached s3transfer-0.4.2-py2.py3-none-any.whl (79 kB)
Collecting keras
  Using cached keras-2.11.0-py2.py3-none-any.whl (1.7 MB)
Collecting pathlib2>=2.3.0
  Using cached pathlib2-2.3.7.post1-py2.py3-none-any.whl (18 kB)
Collecting attrs>=18.0
  Using cached attrs-23.1.0-py3-none-any.whl (61 kB)
Collecting PyYAML>=3.12
  Using cached PyYAML-6.0-cp37-cp37m-win_amd64.whl (153 kB)
Collecting urllib3>=1.21.1
  Using cached urllib3-2.0.2-py3-none-any.whl (123 kB)
Collecting pyjwt<2.5.0,>=2.4.0; python_version > "3.5"
  Using cached PyJWT-2.4.0-py3-none-any.whl (18 kB)
Collecting psutil>=3.4.2
  Using cached psutil-5.9.5-cp36-abi3-win_amd64.whl (255 kB)
Collecting pyparsing>=2.0.3
  Using cached pyparsing-3.0.9-py3-none-any.whl (98 kB)
Collecting Pillow>=4.1.1
  Using cached Pillow-9.5.0-cp37-cp37m-win_amd64.whl (2.5 MB)
Collecting python-dateutil>=2.6.1
  Using cached python_dateutil-2.8.2-py2.py3-none-any.whl (247 kB)
Collecting jsonschema>=2.6.0
  Using cached jsonschema-4.17.3-py3-none-any.whl (90 kB)
Collecting numpy>=1.10
  Using cached numpy-1.21.6-cp37-cp37m-win_amd64.whl (14.0 MB)

1683324031305 Mateus-DSV:0 DEBUG Collecting six>=1.13.0
  Using cached six-1.16.0-py2.py3-none-any.whl (11 kB)
Collecting requests>=2.20.0
  Using cached requests-2.30.0-py3-none-any.whl (62 kB)
Collecting furl>=2.0.0
  Using cached furl-2.1.3-py2.py3-none-any.whl (20 kB)
Collecting importlib-metadata; python_version < "3.8"
  Using cached importlib_metadata-6.6.0-py3-none-any.whl (22 kB)
Collecting importlib-resources>=1.4.0; python_version < "3.9"
  Using cached importlib_resources-5.12.0-py3-none-any.whl (36 kB)
Collecting typing-extensions; python_version < "3.8"
  Using cached typing_extensions-4.5.0-py3-none-any.whl (27 kB)
Collecting pkgutil-resolve-name>=1.3.10; python_version < "3.9"
  Using cached pkgutil_resolve_name-1.3.10-py3-none-any.whl (4.7 kB)
Collecting pyrsistent!=0.17.0,!=0.17.1,!=0.17.2,>=0.14.0
  Using cached pyrsistent-0.19.3-cp37-cp37m-win_amd64.whl (62 kB)
Collecting idna<4,>=2.5
  Using cached idna-3.4-py3-none-any.whl (61 kB)
Collecting certifi>=2017.4.17
  Using cached certifi-2022.12.7-py3-none-any.whl (155 kB)
Collecting charset-normalizer<4,>=2
  Using cached charset_normalizer-3.1.0-cp37-cp37m-win_amd64.whl (94 kB)
Collecting orderedmultidict>=1.0.1
  Using cached orderedmultidict-1.0.1-py2.py3-none-any.whl (11 kB)
Collecting zipp>=0.5
  Using cached zipp-3.15.0-py3-none-any.whl (6.8 kB)
ERROR: botocore 1.20.112 has requirement urllib3<1.27,>=1.25.4, but you'll have urllib3 2.0.2 which is incompatible.
Installing collected packages: jmespath, six, python-dateutil, urllib3, botocore, s3transfer, boto3, keras, keras-contrib, pathlib2, zipp, typing-extensions, importlib-metadata, attrs, PyYAML, pyjwt, psutil, pyparsing, Pillow, importlib-resources, pkgutil-resolve-name, pyrsistent, jsonschema, numpy, idna, certifi, charset-normalizer, requests, orderedmultidict, furl, clearml

1683324051430 Mateus-DSV:0 DEBUG Successfully installed Pillow-9.5.0 PyYAML-6.0 attrs-23.1.0 boto3-1.17.70 botocore-1.20.112 certifi-2022.12.7 charset-normalizer-3.1.0 clearml-1.10.3 furl-2.1.3 idna-3.4 importlib-metadata-6.6.0 importlib-resources-5.12.0 jmespath-0.10.0 jsonschema-4.17.3 keras-2.11.0 keras-contrib-2.0.8 numpy-1.21.6 orderedmultidict-1.0.1 pathlib2-2.3.7.post1 pkgutil-resolve-name-1.3.10 psutil-5.9.5 pyjwt-2.4.0 pyparsing-3.0.9 pyrsistent-0.19.3 python-dateutil-2.8.2 requests-2.30.0 s3transfer-0.4.2 six-1.16.0 typing-extensions-4.5.0 urllib3-2.0.2 zipp-3.15.0

clearml_agent: ERROR: Could not install task requirements!
[WinError 123] A sintaxe do nome do arquivo, do nome do diret�rio ou do r�tulo do volume est� incorreta: '\\C:\\Users\\mateus.ca\\.clearml\\pip-download-cache\\cu0\\keras_contrib-2.0.8-py3-none-any.whl'


1683324051500 Mateus-DSV:0 DEBUG Process failed, exit code 1

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DistressedCoyote60
				
					0
					 × 1

Can you try to set this in your clearml.conf:

agent.pip_download_cache.enabled: false

this should disable the local caching, of your wheel, I suspect there is some issue with the local cache file in windows...

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Hi @<1523701205467926528:profile|AgitatedDove14> ,

I'm registering the wheels with http:// .

Internally it's taking this URL and downloading the file, building the path with file:///

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DistressedCoyote60
				
					0
					 × 1

Write your answer

961 Views

10 Answers

one year ago