I Am Using The Aws Autoscaler And I Wish To Set My Files Server To Be Gs. I Tried To Do So By Having This In The Additional Clearml Configuration Window:

Answered

I am using the AWS autoscaler and I wish to set my files server to be gs.
I tried to do so by having this in the ADDITIONAL CLEARML CONFIGURATION window:
api.files_server: sdk.google.storage.credentials_json: "/root/gs.cred" sdk.google.storage.project: "ml-tooling-test-external" agent.extra_docker_arguments: ["--ipc=host", ] files { gsc { contents: {***hidden***} path: "/root/gs.cred" } }but I see that artifacts were loaded to https://files.clear.ml/
What would be the correct setting?

  				
Posted 
	one year ago

					More
				  		
  Report
		
					PanickyMoth78
				
					0
					 × 1

Votes Newest

Answers 2

Hi PanickyMoth78
Hmm it I think it might be that it overrides it with the environment variables it sets ...
optional one, add:
sdk.development.default_output_uri: " "https://github.com/allegroai/clearml-agent/blob/d96b8ff9068233103053bfe8305fb88274c2c9bf/docs/clearml.conf#L404
Option two (which should work as well):
environment { CLEARML_FILES_HOST: " " }https://github.com/allegroai/clearml-agent/blob/d96b8ff9068233103053bfe8305fb88274c2c9bf/docs/clearml.conf#L421

  				
Posted 
	one year ago

					More
				  		
  Report
		
					AgitatedDove14
				
					0
					 × 1

I tried the first option and it worked 🙂 🙏

  				
Posted 
	one year ago

					More
				  		
  Report
		
					PanickyMoth78
				
					0
					 × 1

Write your answer

658 Views

2 Answers

one year ago