Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Guys! Anyone Else Has Trouble Caching Virtual Environments In The Agent? I Manually Installed A Single Agent On A Virtual Machine, And I'M Using This Conf For Venv Caching :

Hi guys! Anyone else has trouble caching virtual environments in the agent?
I manually installed a single agent on a virtual machine, and I'm using this conf for venv caching :
venvs_cache: { # maximum number of cached venvs max_entries: 10 # minimum required free space to allow for cache entry, disable by passing 0 or negative value free_space_threshold_gb: -1 # unmark to enable virtual environment caching path: ~/.clearml/venvs-cache }
Yet every time I enqueue a copy of a task, it reinstall all the packages. The directory ~/.clearml/venvs-cache is empty.
I'm using poetry to manage requirements in the task, could that be the problem?

  
  
Posted 16 days ago
Votes Newest

Answers 6


@<1691620877822595072:profile|FlutteringMouse14> , can you try upgrading to the latest available? 1.8.1rc2

  
  
Posted 16 days ago

@<1523701070390366208:profile|CostlyOstrich36> It's 1.8.0

  
  
Posted 16 days ago

@<1694157594333024256:profile|DisturbedParrot38> thanks a lot! I didn't know it. On my project, clearml can't recognize the requirements from the code, I have to pass them explicitly, either with poetry or with a requirements.txt. Does that work for you?

  
  
Posted 16 days ago

I noticed poetry can be a problem in my run.
Not specifically due to the cache, but due to the installation of much more packages than the runtime might need.

When using regular pip, it will use the requirements list determined by ClearML to install necessary packages, which usually already excludes all dev-tools and similar.

I am not sure if poetry uses the cache properly, but I can't verify either atm.

  
  
Posted 16 days ago

When developing I use the poetry environment, but in the queues I let clearML handle the installation via pip.

There is no need to use poetry if the task is a one-time thing

  
  
Posted 16 days ago

@<1691620877822595072:profile|FlutteringMouse14> , what version of the agent are you using?

  
  
Posted 16 days ago
161 Views
6 Answers
16 days ago
16 days ago
Tags