Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Guys, There Is A Bug Introduced With Clearml-Agent 1.5.0: The Resolution Of The Torch Version Is Broken: It Will Try To Find The Torch Version Matching The Cuda Version Of The System, As Opposed To Version 1.4.1, Where It Tries To Find The Cuda Version

Hi guys, there is a bug introduced with clearml-agent 1.5.0: the resolution of the torch version is broken: it will try to find the torch version matching the cuda version of the system, as opposed to version 1.4.1, where it tries to find the cuda version compatible with the requested torch version

clearml-agent 1.4.1 , python 3.8, cuda 117, pip 20.2.3, torch==1.11.0 required:` Torch CUDA 117 download page found
Warning, could not locate PyTorch torch==1.11.0 matching CUDA version 117, best candidate 1.13.0

Torch CUDA 116 download page found
Trying PyTorch CUDA version 116 support
Warning, could not locate PyTorch torch==1.11.0 matching CUDA version 116, best candidate 1.13.0

Torch CUDA 115 download page found
Trying PyTorch CUDA version 115 support
Warning, could not locate PyTorch torch==1.11.0 matching CUDA version 115, best candidate 1.12.0

Found PyTorch version torch==1.11.0 matching CUDA version 115
Collecting torch==1.11.0+cu115
Downloading (2138.5 MB)

━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 2.1/2.1 GB ? eta 0:00:00
Saved /root/.clearml/pip-download-cache/cu117/torch-1.11.0+cu115-cp38-cp38-linux_x86_64.whl
Successfully downloaded torch clearml-agent 1.5.0, python 3.8, cuda 117, pip 20.2.3, torch==1.11.0 required: Torch CUDA 117 index page found
Looking in indexes: ,
Collecting torch==1.13.0
Downloading (1806.8 MB) `

  
  
Posted one year ago
pic
More
JitteryCoyote63
0 × 1
Report
Votes Newest

Answers 6

JitteryCoyote63 ReassuredTiger98
Could you please try with the latest agent 1.5.2rc0 and let us know if it solved the issue?

  
  
Posted one year ago
pic
More
AnxiousSeal95
0 × 1
Report

AnxiousSeal95 Thanks a lot. Seems to be working fine for me. I see the clearml-agent version that pip installs in the docker is now fixed to the host version 🙂 PyTorch Nightly is also installed correctly now!

  
  
Posted one year ago
pic
More
ReassuredTiger98
0 × 1
Report

ReassuredTiger98 that's great to hear 🙂

  
  
Posted one year ago
pic
More
AnxiousSeal95
0 × 1
Report

ReassuredTiger98 Nice digging and Ouch...that isn't fun. Let me see how quickly I can get eyes on this 🙂

  
  
Posted one year ago
pic
More
AnxiousSeal95
0 × 1
Report

JitteryCoyote63 can you share the full log for both cases?

  
  
Posted one year ago
pic
More
SuccessfulKoala55
0 × 1
Report

AnxiousSeal95 This bug seems to be affecting me. I just tried forcing clearml-agent to install clearml-agent==1.4.1 in the docker and now it works.
Btw: clearml-agent uses pip install clearml-agent -U to install clearml-agent in the docker. However, instead of using the newest clearml-agent it should use the version that the host machine is using to run clearml-agent in my opinion.

  
  
Posted one year ago
pic
More
ReassuredTiger98
0 × 1
Report
Write your answer
1K Views
6 Answers
one year ago
one year ago
Tags
clearml
Similar posts