Hi All, How Can We Clear The Local Dataset Cache In Clearml?

Answered

Hi all,

How can we clear the local dataset cache in ClearML?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DepravedDolphin12
				
					0
					 × 1

Votes Newest

Answers 2

Hi @<1587615463670550528:profile|DepravedDolphin12> , your cache is defined by your clearml.conf you can see where it points and delete that folder 🙂

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Thanks for your response @<1523701070390366208:profile|CostlyOstrich36> 🙂

I thought about doing the same but clearml setup is done using root privileges so even cache folder is generated with root privilege. So I was just wondering if clearml CLI exposes any API to refresh cache.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					DepravedDolphin12
				
					0
					 × 1

Write your answer

907 Views

2 Answers

one year ago

Hi Everyone! I Have A Clearml Dataset That Takes Up 10 Tb. Its Local Download (Get_Local_Copy) Takes About A Month. Can You Tell Me How To Speed Up This Process? I Keep The Cache In Nfs.

Hi All, Quick Question About Clearml Datasets. Does Anyone Know If It Is Possible To Access (Could Just Be Paths To The Data In A Bucket) A Dataset Directly From S3, Instead Of Downloading A Local Copy? We Typically Store And Access Large Quantities Of

Hi Everyone! Is There A Way To Force An Agent To Clear The Clearml Cache Folder Every Time It’S Done With A Task? I Have A Machine Running Multiple Agents For Training, But The Disk Space Gets Filled Up Quickly Since Every New Task Uses A New Dataset. I S

Hello Guys I Have A Question About Local Cache Right Now Im Trying To Store In Cache A Pretty Large Dataset (Over 20Mil Files And 3Tb Of Data) I Use A

Hi Guys, I Have Data ( For Folder Tree Image Classification) And We Stored That On S3 Bucket Minio Can I Register Dataset To Clearml Without Downloading (Using Storage Manager) Data On S3 Bucket To My Local Then Upload To Clearml?