Hi Everyone, My Team Used To Store Artifacts (Model, Data, Etc.) Outside The Clearml Server, S3 For Example. Now, We’Ve Decided To Move All Artifacts To Another Bucket. The Problem Is This Will Cause The Mismatch Between The Actual Uris Pointed To The Ar

Answered

Hi everyone,

My team used to store artifacts (model, data, etc.) outside the ClearML server, S3 for example. Now, we’ve decided to move all artifacts to another bucket.
The problem is this will cause the mismatch between the actual URIs pointed to the artifacts and the URIs stored and managed by the ClearML server.
Is it possible to change all the URIs on the ClearML server to match the new destination bucket?

Thanks!

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					GrittyKangaroo27
				
					0
					 × 1

Votes Newest

Answers 4

Hi GrittyKangaroo27 , yeah, it's possible using a maintenance script you can run on the server itself. There was a similar question some time ago, I'll try to find it with the example script I've shared there 🙂

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

And here's for data stored in ES: https://clearml.slack.com/archives/CTK20V944/p1631037530225100?thread_ts=1631031994.223100&cid=CTK20V944

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

So here's an example for models (stored in the mongodb): https://clearml.slack.com/archives/CTK20V944/p1618471688490400

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Awesome! Thanks! SuccessfulKoala55

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					GrittyKangaroo27
				
					0
					 × 1

Write your answer

617 Views

4 Answers

2 years ago

one year ago