Hello! I Am Setting Up A Clearml-Server With Self-Hosted Minio. Do I Would Like To Keep The Clearml.Conf As Default As Possible (Such That Users Do Not Need To Configure Much And Do Not Need Access To Mino Keys). I Am Trying To Use The Server-Config File

Answered

Hello!
I am setting up a clearml-server with self-hosted minio. Do I would like to keep the clearml.conf as default as possible (such that users do not need to configure much and do not need access to mino keys).

I am trying to use the server-config file “services.conf” to point clearml-server to minio. Here’s the config:

storage_credentials {
aws {
    s3 {
	# S3 credentials, used for read/write access by various SDK elements
	# default, used for any bucket not specified below
	key: ""
	secret: ""
	region: ""
	use_credentials_chain: false
	# Additional ExtraArgs passed to boto3 when uploading files. Can also be set per-bucket under "credentials".
	extra_args: {}
	credentials: [
	    # specifies key/secret credentials to use when handling s3 urls (read or write)
	    # {
	    #     bucket: "my-bucket-name"
	    #     key: "my-access-key"
	    #     secret: "my-secret-key"
	    # },
	    {
	        # This will apply to all buckets in this host (unless key/value is specifically provided for a given bucket)
	        host: "localhost:9000"#"127.0.01:9000"
	        bucket: "clearmldata"
	        key: "accesskey"
	        secret: "secretkey"
	        # region: my-server
	        multipart: false
	        secure: false
	    }
	]
    }
}
}

But the created/uploaded datasets still end up in the default path: /opt/clearml/data/fileserver/

I want all clearml data to be stored in minio.

What can I do? 😮

Thank you for your help!!

  				
Posted 
	15 days ago

					More  		
  Report
		
					ObedientTurkey46
				
					0
					 × 1

Votes Newest

Answers 8

Here’s how I do it using clearml.conf config for my agent:

sdk {
  aws {
    s3 {
      ...
    }
  }
  development {
    default_output_uri: "

"
  }
}

  				
Posted 
	15 days ago

					More  		
  Report
		
					WobblyFrog79
				
					0
					 × 1

Hi ObedientTurkey46 , yeah, that's correct. Please note that setting that on the server side will not cause this to apply for all the user's it will just allow the server to delete task related artifacts when you delete a task.

  				
Posted 
	15 days ago

					More  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

Thank you for replying 🙂
I need to configure this in every clearml.conf for each data-scientist. Correct?

  				
Posted 
	15 days ago

					More  		
  Report
		
					ObedientTurkey46
				
					0
					 × 1

Can you explain why a user needs to configure the minio connection locally? My understanding was, that the data is up/downloaded to/from clearml-server, and where clearml-server is storing the data is to be configured on the server itself.

  				
Posted 
	14 days ago

					More  		
  Report
		
					ObedientTurkey46
				
					0
					 × 1

The way I understand it:

if you’re executing tasks locally (e.g. on your laptop) then you need this setting because the clearml package needs to know where to upload artifacts (artifacts aren’t proxied through the clearml-server they are rather uploaded directly to the storage of your choice)
if you’re executing code using ClearML agent, then you can configure agent the way I wrote earlier, and it will use your MinIO instance for uploading artifacts for all of the tasks it executes

  				
Posted 
	14 days ago

					More  		
  Report
		
					WobblyFrog79
				
					0
					 × 1

Do you know what is going on? 🙂 Thank you!

  				
Posted 
	13 days ago

					More  		
  Report
		
					ObedientTurkey46
				
					0
					 × 1

I don’t use datasets so I don’t know, sorry, maybe SuccessfulKoala55 can help

  				
Posted 
	12 days ago

					More  		
  Report
		
					WobblyFrog79
				
					0
					 × 1

Thank you! That makes sense, and adding default_output_uri solved the issue.

Unfortunately, I now have the next issue. When deleting a Dataset I created for test purposes in the UI, it is not automatically deleted by clearml in minio. Do you know if I have missconfigured clearml in some way?

  				
Posted 
	13 days ago

					More  		
  Report
		
					ObedientTurkey46
				
					0
					 × 1

Write your answer

83 Views

8 Answers

15 days ago

12 days ago