Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Apart From Having Packages In Requirements.Txt, Does Clearml Expect Them To Be Actuall Installed To Add Them As Installed Packages For A Task?

Apart from having packages in requirements.txt, does clearml expect them to be actuall installed to add them as installed packages for a task?

  
  
Posted 3 years ago
Votes Newest

Answers 12


AgitatedDove14 ^^

  
  
Posted 3 years ago

I am doing Task.init but it’s not adding expected libraries imported in the script or from requirements.txt

  
  
Posted 3 years ago

Is it not possible to say just look at my requirements.txt file and the imports in the script?

I think there is a GitHub Issue for this feature
(basically the issue is, requirements.txt are very often not updated, and have no real version lock, so replicating a working env is always safer)

  
  
Posted 3 years ago

Ok i did a pip install -r requirements.txt and NOW it picks them up correctly
So packages have to be installed and not just be mentioned in requirements / imported?

Yes, it looks for them locally so it has all the specific versions you need.
If the "installed packages" is totally empty the agent will revert to looking for requirements.txt inside the repository.

  
  
Posted 3 years ago

So packages have to be installed and not just be mentioned in requirements / imported?

  
  
Posted 3 years ago

irrespective of what I actually have installed when running the script?

  
  
Posted 3 years ago

Is it not possible to say just look at my requirements.txt file and the imports in the script?

  
  
Posted 3 years ago

Ok i did a pip install -r requirements.txt and NOW it picks them up correctly

  
  
Posted 3 years ago

Thanks for the confirmation.

  
  
Posted 3 years ago

To confirm, if i have fresh venv with no dependency installed except clearml

I have a requirements.txt file in root, and a script at scripts/script1.py

The script1.py does task.init(), execute_remotely and then imports few dependenceies

Now I run python scripts/script1.py

And it should pick up the installed packages correctly?

  
  
Posted 3 years ago

It analyses the script code itself, going over all imports and adding only the directly imported packages

  
  
Posted 3 years ago

does clearml expect them to be actuall installed to add them as installed packages for a task?

It should add itself to the list (assuming you will end up calling Task.init in your code)

  
  
Posted 3 years ago