Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Guys, There Is A Bug Introduced With Clearml-Agent 1.5.0: The Resolution Of The Torch Version Is Broken: It Will Try To Find The Torch Version Matching The Cuda Version Of The System, As Opposed To Version 1.4.1, Where It Tries To Find The Cuda Version

Hi guys, there is a bug introduced with clearml-agent 1.5.0: the resolution of the torch version is broken: it will try to find the torch version matching the cuda version of the system, as opposed to version 1.4.1, where it tries to find the cuda version compatible with the requested torch version

clearml-agent 1.4.1 , python 3.8, cuda 117, pip 20.2.3, torch==1.11.0 required:` Torch CUDA 117 download page found
Warning, could not locate PyTorch torch==1.11.0 matching CUDA version 117, best candidate 1.13.0

Torch CUDA 116 download page found
Trying PyTorch CUDA version 116 support
Warning, could not locate PyTorch torch==1.11.0 matching CUDA version 116, best candidate 1.13.0

Torch CUDA 115 download page found
Trying PyTorch CUDA version 115 support
Warning, could not locate PyTorch torch==1.11.0 matching CUDA version 115, best candidate 1.12.0

Found PyTorch version torch==1.11.0 matching CUDA version 115
Collecting torch==1.11.0+cu115
Downloading (2138.5 MB)

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 GB ? eta 0:00:00
Saved /root/.clearml/pip-download-cache/cu117/torch-1.11.0+cu115-cp38-cp38-linux_x86_64.whl
Successfully downloaded torch clearml-agent 1.5.0, python 3.8, cuda 117, pip 20.2.3, torch==1.11.0 required: Torch CUDA 117 index page found
Looking in indexes: ,
Collecting torch==1.13.0
Downloading (1806.8 MB) `

  
  
Posted 2 years ago
Votes Newest

Answers 6


AnxiousSeal95 This bug seems to be affecting me. I just tried forcing clearml-agent to install clearml-agent==1.4.1 in the docker and now it works.
Btw: clearml-agent uses pip install clearml-agent -U to install clearml-agent in the docker. However, instead of using the newest clearml-agent it should use the version that the host machine is using to run clearml-agent in my opinion.

  
  
Posted 2 years ago

ReassuredTiger98 that's great to hear 🙂

  
  
Posted 2 years ago

ReassuredTiger98 Nice digging and Ouch...that isn't fun. Let me see how quickly I can get eyes on this 🙂

  
  
Posted 2 years ago

JitteryCoyote63 ReassuredTiger98
Could you please try with the latest agent 1.5.2rc0 and let us know if it solved the issue?

  
  
Posted 2 years ago

AnxiousSeal95 Thanks a lot. Seems to be working fine for me. I see the clearml-agent version that pip installs in the docker is now fixed to the host version 🙂 PyTorch Nightly is also installed correctly now!

  
  
Posted 2 years ago

JitteryCoyote63 can you share the full log for both cases?

  
  
Posted 2 years ago