ClearML FAQ | Hi! I Have A Dataset Like This: V1.0.0

Answered

Hi! I Have A Dataset Like This: V1.0.0

Hi! I have a dataset like this:
v1.0.0

file_1.csv
file_2.csvv1.0.1
file_2.csv
file_3.csvv1.0.2
file_3.csv
file_4.csvHow can I get a new dataset with:
file_1.csv
file_2.csv
file_3.csv
file_4.csvwhere I always keep the latest version of each file?

  				
Posted 
	10 months ago

					More
				  		
  Report
		
					AbruptCow41
				
					0
					 × 1

Votes Newest

Answers 3

if I squash, this will rewrite the datasets, right? I want a new dataset, but keeping those there

  				
Posted 
	10 months ago

					More
				  		
  Report
		
					AbruptCow41
				
					0
					 × 1

You can create a new dataset and specify the parent datasets as all the previous ones. Is that something that would work for you ?

  				
Posted 
	10 months ago

					More
				  		
  Report
		
					EnthusiasticShrimp49
				
					0

that depends…would that only keep the latest version of each file?

  				
Posted 
	10 months ago

					More
				  		
  Report
		
					AbruptCow41
				
					0
					 × 1

Write your answer

556 Views

3 Answers

10 months ago

10 months ago

Tags

Similar posts

Hi! Is There Any Way To Add Git-Like Ignore File For Versioning Clearml Data? I Saw In Docs A Wildcard Argument When Files Are Added To A Dataset. How Can I Specify Ignoring Of Some File Types? For Example, I Want To Ignore Ipynb Checkpoints. How Can I Do

Hey All, I Have A Question That Might Have Been Asked Before But I Can'T Find An Answer On This Slack Channel Or The Github So I Hope Somebody Can Help Me. I Have Created A Dataset Via The Python Sdk With A Local Path As The Output Uri Like So:

Hello, Clearml.Task Has Great Ability Save Environment State Like Packages Uncommited Changes Etc. How Can I Get The Same Effect When Creating Clearml.Dataset, It Doesnt Save The Package List. When Looking At Dataset Page, I See The Dataset Upload Task Bu

Hello. I Am Currently Using A Clearml Server On-Premises. Thank You For The Great Tool! I Would Like To Ask About The Status Of The Clearml-Server And Clearml-Web Github Repositories. I Think That Clearml-Server 1.13 Is Currently Released As The Latest Ve

Hi All, I Was Trying To Use Clearml-Task To Run A Custom Docker(With Poetry To Install All The Python Dependencies And Activated The Environment) Using Clearml Gpu, But It Seems Like Clearml Always Create A Virtual Environment And Run The Python Script Fr

I'M A Bit Confused. It Seems Like Something Has Changed With How Clearml Handles Recording Datasets In Tasks. It Used To Be The Case That When I Would Create A Dataset Under A Task, Clearml Would Record The Id Of The Dataset In The Hyperparameters/Datase

I Uploaded Direct Access File To Clearml Dataset System Like This One. How Can I Access The Link Of The Uploaded Item. Whenever I Try To Call

Hello Everybody, I Would Like To Start Off By Saying That I Absolutely Love Clearml. I Am Getting Familiar With Clearml Datasets And I Have A Quick Question. Is Is Possible To Download Individual Files From A Dataset Without Downloading The Entire Datase

Hi Team Could We Change The Time Duration Of The Last Run In Particular Project Where It Should Be Showing Like 1 Week Than Completed(24Hr) Always. I Have Got The Enterprise Level Access(Pro). Pfa.

Hi, A Question About Dataset Storage Suppose I Create A Dataset Like This