Hi Clearml Team, Is There Best Practice To Improve Dataset'S Storage Efficiency? For Example, I Don'T Really Need All 5 Versions Of The Same Dataset Get Saved/Remembered, Is There A Way To Prune Old Versions Of Datasets To Be More Storage Efficient?

Answered

Hi clearml team, is there best practice to improve dataset's storage efficiency? For example, I don't really need all 5 versions of the same dataset get saved/remembered, is there a way to prune old versions of datasets to be more storage efficient?

  				
Posted 
	19 days ago

					More  		
  Report
		
					ScrawnyCrocodile51
				
					0
					 × 1

Votes Newest

Answers 2

Hi ScrawnyCrocodile51 , I think you're looking for Dataset.squash - None

  				
Posted 
	19 days ago

					More  		
  Report
		
					CostlyOstrich36
				
					0

Hi John, the dataset.squash doc says "If a set of versions are given it will squash the versions diff into a single version", I want to double check will it only keep the latest version?

Because I don't want any old version stuff even old version have more stuff than the latest version

  				
Posted 
	18 days ago

					More  		
  Report
		
					ScrawnyCrocodile51
				
					0
					 × 1

Write your answer

89 Views

2 Answers

19 days ago

18 days ago