ClearML FAQ | Hi, What Is The Best Way To Add New Data To The Uploaded Dataset. Currently, Uploaded Dataset Stored In Clearml Have This Structure.

Answered

Hi, What Is The Best Way To Add New Data To The Uploaded Dataset. Currently, Uploaded Dataset Stored In Clearml Have This Structure.

Hi,
What is the best way to add new data to the uploaded dataset.

Currently, uploaded dataset stored in Clearml have this structure.

Dataset_rootpreprocess_Aimage files
I want to add the folder that contains the same images as preprocess_A under Dataset_root.

Thanks

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					VictoriousPenguin97
				
					0
					 × 1

Votes Newest

Answers 5

https://clear.ml/docs/latest/docs/references/sdk/dataset/#datasetcreate

Please try the following

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Hi, how did you save the dataset so far?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Try creating a new version and syncing the local folder (or try to specifically add files) 🙂

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

Sorry, how to create a new version of dataset.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					VictoriousPenguin97
				
					0
					 × 1

I execute add_file and then, upload.

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					VictoriousPenguin97
				
					0
					 × 1

Write your answer

654 Views

5 Answers

2 years ago

one year ago

Tags

Similar posts

Hi, Is There Any Possibility To Add Some Best Practises For Self-Hosted Docker Solution To Docs? For Example How To Serve This Awesome Project On Https. I Would Like To Help With Example Nginx Config, But I Don'T Know The Project Requirements For This Sol

Aws Autoscaler Question: What Is Best Practices For Providing The Autoscaled Instances With Access To Credentials For Things Like S3? With Self-Hosted Agents I Can Add The Credentials To The Clearml Config As Part Of The Environment Variables.

Hi, What Would Be The Best Practice For Using The Datasets When Testing Different Features? Should I Just Add New Dataset Each Time I Try New Feature To The Dataset And Specify The Previous One As Parent?

Hi! Working On Deploying Clearml To Aws Eks And Looking For A Way To Initialize Projects And Designated Queues For Agents. Are There Any Best Practices For This Or Should I Just Add A Command When Starting Up The Api Server (I.E., Send Some Http Requests

Hi! Is There A Way To Get The Best Model Among The Models Stored In Clearml? For Example, I Would Like To Make An Inference Using A Model Whose Acuity Is The Best In Clearml I Tried

Hello There! I Have A Question Regarding The Web Ui, On The Project Page: I Have The Following Use Case: I Need To Add Two Custom Columns, Each Reporting One Metric. Currently, This Shows Me The Best (Min/Max) Values Reached By The Model, But Not Necessar

I Am Starting To Use Clearml-Data, And I Have A Feature Request - Add A Progress Bar For The Upload Phase / Log Which Files Are Uploaded / Add Upload Speed Currently When Uploading Large Amounts Of Data, We Can An Obscure Message Of

We Can’T Add Overview To The Subprojects (Btw Thank You So Much For Subprojects, This Is Probably The Best Feature Ever Introduced To Trains/Clearml). Is It Intended? When I Click Overview For The Subproject, It Just Shows An Empty Page Without Any Button

Hi All, I Have An Issue With The Way Hyper Parameters Are Logged Under Configuration, The Values That Are Stored Seem To Add Unnecessary Escape Characters To The Original Values.. Is It A Known Issue? Is There A Way To Change It? Thanks

Hi, I Would Like To Add Artifacts From Two Parallel Process In The Same Task. But One One Process Finished It Changed Task Status To Complete. May Be You Know Some Save Way To Deal With Such Situation? Or Maybe The Best Way To Check Task Status Before Upl