Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello! Since Today I Get

Hello!
Since today I get AssertionError: Torch not compiled with CUDA enabled for PyTorch 1.8.
Tasks that I submitted yesterday to the queue are also not working, even though they ran yesterday. PyTorch 1.7 based tasks work fine. Any idea what I could have done wrong?

  
  
Posted 3 years ago
Votes Newest

Answers 161


This is the file which installs the GPU version

  
  
Posted 3 years ago

(This is why we recommend using pip, because it is stable and clearml-agent takes care of pytorch/cuda verions)

  
  
Posted 3 years ago

And the one with the CPU version? is it with "~=" or "="?

  
  
Posted 3 years ago

I tried "~=", "==" and "="

  
  
Posted 3 years ago

I will try a minimal version now

  
  
Posted 3 years ago

channels:
- defaults
- conda-forge
- pytorch
dependencies:
- cudatoolkit==11.1.1
- pytorch==1.8.0

Gives CPU version

  
  
Posted 3 years ago

Wtf? can you try with = (notice single not double)?

channels:
- defaults
- conda-forge
- pytorch
dependencies:
- cudatoolkit=11.1.1
- pytorch=1.8.0
  
  
Posted 3 years ago

Installs CPU

  
  
Posted 3 years ago

Ha?!

  
  
Posted 3 years ago

But here is the funny thing:

channels:
- pytorch
- conda-forge
- defaults
dependencies:
- cudatoolkit=11.1.1
- pytorch=1.8.0

Installs GPU

  
  
Posted 3 years ago

The ordering of the channels seems to matter!

  
  
Posted 3 years ago

WTF?!

  
  
Posted 3 years ago

I try it one more time just to make sure

  
  
Posted 3 years ago

okay, I'll make sure we order it correctly

  
  
Posted 3 years ago

Just tested again. The ordering definitly matters.

  
  
Posted 3 years ago

Damn, okay I'll make sure we fix the order.
Could you verify the ~= works as intended (if the order id correct)

  
  
Posted 3 years ago

@<1523701868901961728:profile|ReassuredTiger98> thank you so much for testing it!

  
  
Posted 3 years ago

channels:
- pytorch
- conda-forge
- defaults
dependencies:
- cudatoolkit~=11.1.1
- pytorch~=1.8.0

Works fine

  
  
Posted 3 years ago

Great, thanks!

  
  
Posted 3 years ago

No problem! I profit so much from clearml 🙂

  
  
Posted 3 years ago

Can you ping me when it is updated in None so I can update my installation?

  
  
Posted 3 years ago

Will do!

  
  
Posted 3 years ago

@<1523701868901961728:profile|ReassuredTiger98> what do you have in the clearml.conf under "conda_channels" ?
Is this it ?
None

  
  
Posted 3 years ago

conda_channels: ["defaults", "conda-forge", "pytorch", ]
  
  
Posted 3 years ago

Well, in that case, just change the order it should solve it (I'll make sure we have that as the default:

conda_channels: ["pytorch", "conda-forge", "defaults", ]

It should solve the issue 🙂

  
  
Posted 3 years ago

Perfect, will try it. fyi: The conda_channels that I used are from clearml-agent init

  
  
Posted 3 years ago

Yes that is exactly what I will make sure we change :)

  
  
Posted 3 years ago

Thank you! 🙂

  
  
Posted 3 years ago

One more thing: The cuda_version that clearml finds automatically is wrong.

  
  
Posted 3 years ago

I get 110 but it should be 111

  
  
Posted 3 years ago
12K Views
161 Answers
3 years ago
5 months ago
Tags