How Do I Disable

Answered

How Do I Disable

How do I disable completely any kind of python env caching by the agents?
I tried having

     venvs_cache: {
        # maximum number of cached venvs
        max_entries: 10
        # minimum required free space to allow for cache entry, disable by passing 0 or negative value
        free_space_threshold_gb: 0
        # unmark to enable virtual environment caching
        path: ~/.clearml/venvs-cache
    },

in my clearml.conf file, but it's still caching the envs 😭

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ElegantCoyote26
				
					0
					 × 1

Votes Newest

Answers 7

I think it's still caching environments... I keep deleting the caches (pip, vcs, venvs-*) and running an experiment. it re-creates all these folders and even prints


Requirement already satisfied: idna<4,>=2.5 in /usr/local/lib/python3.8/dist-packages (from requests>=2.20.0->clearml==1.6.4->prediction-service-utilities==0.1.0) (3.4)
Requirement already satisfied: charset-normalizer<4,>=2 in /root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages (from requests>=2.20.0->clearml==1.6.4->prediction-service-utilities==0.1.0) (3.0.1)
Requirement already satisfied: sniffio>=1.1 in /root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages (from anyio<4,>=3.0.0->starlette==0.17.1->fastapi<0.76,>=0.73.0->prediction-service-utilities==0.1.0) (1.3.0)
Requirement already satisfied: zipp>=3.1.0 in /root/.clearml/venvs-builds/3.8/lib/python3.8/site-packages (from importlib-resources>=1.4.0->jsonschema>=2.6.0->clearml==1.6.4->prediction-service-utilities==0.1.0) (3.12.1)
Adding venv into cache: /root/.clearml/venvs-builds/3.8

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ElegantCoyote26
				
					0
					 × 1

path: ~/.clearml/venvs-cache

# path: ~/.clearml/venvs-cache

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

@<1523701205467926528:profile|AgitatedDove14> any ideas?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ElegantCoyote26
				
					0
					 × 1

yep, setting it to -1 is still caching envs..

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ElegantCoyote26
				
					0
					 × 1

@<1523701087100473344:profile|SuccessfulKoala55> hey Jake, how do i check how many envs it caches? doing ls -la .clearml/venvs-cache gives me two folders

  				
Posted 
	one year ago

					More
				  		
  Report
		
					ElegantCoyote26
				
					0
					 × 1

How many envs does it cache?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Hi @<1523701099620470784:profile|ElegantCoyote26> , what happens if you define the cache size to be -1?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Write your answer

984 Views

7 Answers

one year ago