ClearML FAQ | Hi, Newbe Question In Clearml Data Assuming My Files Are Already In A Bucket On The Cloud - What Would Be The Best Practice To Create A Dataset And Register It In Clearml?

Answered

Hi, Newbe Question In Clearml Data Assuming My Files Are Already In A Bucket On The Cloud - What Would Be The Best Practice To Create A Dataset And Register It In Clearml?

Hi,
Newbe question in ClearML Data
Assuming my files are already in a bucket on the cloud -
What would be the best practice to create a dataset and register it in ClearML?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					OutrageousSheep60
				
					0
					 × 1

Votes Newest

Answers 6

OutrageousSheep60 The python package is in testing. Hopefully will be out Sunday \ Monday :)

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AnxiousSeal95
				
					0
					 × 1

OutrageousSheep60 took a bit longer but SDK 1.4.0 is out 😄 please check the links feature in clearml-data 🙂

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AnxiousSeal95
				
					0
					 × 1

I think there might be some option, let me check if I can find something I have 🙂

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

👍

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					OutrageousSheep60
				
					0
					 × 1

Hi OutrageousSheep60 , we have good news and great news for you! (JK, it's all great 😄 ). In the coming week or two we'll release the ability to also add links to clearml-data, so you can bring your s3 (or any other cloud) and local files as links (instead of uploading to the server). 🎉

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					AnxiousSeal95
				
					0
					 × 1

Hi AnxiousSeal95 ,
Is there an estimate when the above feature will be available?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					OutrageousSheep60
				
					0
					 × 1

Write your answer

1K Views

6 Answers

2 years ago

one year ago