On The Clearml Web Interface You Obviously Need To Provide The Aws Credentials To Do Things Like Download Artifacts And Data Stored On Aws. One Thing I'M Curious About Is If You Do Provide The Credentials, When You Do Things Like Delete A Dataset Or Task,

Answered

On the ClearML web interface you obviously need to provide the AWS credentials to do things like download artifacts and data stored on AWS. One thing I'm curious about is if you do provide the credentials, when you do things like delete a dataset or task, will ClearML remove the corresponding folders and files on S3?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					EnthusiasticCow4
				
					0
					 × 1

Votes Newest

Answers 5

Hi @<1545216070686609408:profile|EnthusiasticCow4>

will ClearML remove the corresponding folders and files on S3?

Yes and it will ask you for credentials as well. I think there is a way to configure it so that the backend has access to it (somehow) but this breaks the "federated" approach

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

Hmm so the SaaS service ? and when you delete (not archive) a Task it does not ask for S3 credentials when you select delete artifacts ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

What's the clearml-server version ?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

I'm not self-hosting the server.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					EnthusiasticCow4
				
					0
					 × 1

So far when I delete a task or dataset using the web interface that has artifacts on S3 it doesn't prompt me for credentials.

  				
Posted 
	one year ago

					More
				  		
  Report
		
					EnthusiasticCow4
				
					0
					 × 1

Write your answer

999 Views

5 Answers

one year ago