Hi Guys, I Want Automate The Clearml-Init In A Docker Container. Ideally I Would Do This By Having The Clearml.Conf File In The Container And Then Read In Env Variables I.E. Any Recommendations Would Be Good?

Answered

Hi guys, I want automate the clearml-init in a docker container. Ideally I would do this by having the clearml.conf file in the container and then read in env variables i.e. Any recommendations would be good?

` api {
# Ryan's workspace
web_server: ${CLEARML_WEB_SERVER}
api_server: ${CLEARML_API_SERVER}
files_server: ${CLEARML_FILES_SERVER}
credentials {
"access_key" = ${CLEARML_KEY}
"secret_key" = ${CLEARML_SECRET}
}
}

...

aws {
s3 {
region: ${CLEARML_S3_REGION}
}
} `

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					RobustFox47
				
					0
					 × 1

Votes Newest

Answers 7

I have a wrapper SDK over clearml that includes default conf and others are loaded from secret manager / env vars as needed

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					TrickySheep9
				
					0
					 × 1

RobustRat47 ASAIK this should already be supported by the underlying HOCON configuration format used by ClearML - something like ${PATH} should automatically be substituted by the PATH environment variable ( %PATH% in Windows)

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					SuccessfulKoala55
				
					0
					 × 1

okay so this could be a python script that generates the clearml.conf in the working dir in the container?

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					RobustFox47
				
					0
					 × 1

great thank you it's working. Just wanted to check before adding all env vars 🙂

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					RobustFox47
				
					0
					 × 1

I then install this wrapper SDK in my containers, notebook instances etc

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					TrickySheep9
				
					0
					 × 1

thanks for the speedy response!

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					RobustFox47
				
					0
					 × 1

That’s about what i do

  				
Posted 
	2 years ago

					More
				  		
  Report
		
					TrickySheep9
				
					0
					 × 1

Write your answer

448 Views

7 Answers

2 years ago

11 months ago