Hey! I Was Trying To Use My Minio Instance For Artifacts Storage But There Is Not Way Of Making It Work. Maybe I Am Missing Something. This Is My Clearml.Conf Everything Else Is Working Fine.

Answered

Hey! i was trying to use my minio instance for artifacts storage but there is not way of making it work. Maybe i am missing something. This is my clearml.conf
Everything else is working fine.

` aws {
s3 {
host: "s3.myhost.tld:443"
key: "<mykey>"
secret: "<mysecret>"
secure: true

    credentials: [
        {
            host: "s3.myhost.tld:443"
            key: "<mykey>"
            secret: "<mysecret>"
            secure: true
            multipart: false
        }
    ]
}

}

api {
web_server:
api_server:
file_server:
credentials {
"access_key" = "<clearmlkey>"
"secret_key" = "clearmlsecret>"
}
} `

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TrickyFox41
				
					0
					 × 1

Votes Newest

Answers 6

The error is
2022-11-28 14:40:17,099 - clearml.storage - ERROR - Failed creating storage object Reason: Missing key and secret for S3 storage access ( )

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TrickyFox41
				
					0
					 × 1

Hi TrickyFox41 , are you getting some sort of error?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					CostlyOstrich36
				
					0

if i print config_list from def from_config(cls, s3_configuration): in file bucket_config.py line 121 i get
{'key': '', 'secret': '', 'region': '', 'multipart': True, 'use_credentials_chain': False, 'bucket': 'clearml', 'host': 's3.myhost.tld:443', 'token': '', 'extra_args': ConfigTree()}

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TrickyFox41
				
					0
					 × 1

Nevermind my aws config was not under sdk :face_palm:

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TrickyFox41
				
					0
					 × 1

I installed clearml from source and printed the internal S3 configurations, basically key and secret are empty

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TrickyFox41
				
					0
					 × 1

Everything works fine i force those values using AWS_ACCESS_KEY_ID AWS_SECRET_ACCESS_KEY env variables

  				
Posted 
	one year ago

					More
				  		
  Report
		
					TrickyFox41
				
					0
					 × 1

Write your answer

1K Views

6 Answers

one year ago