Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, Trying To Figure Out How To Run A Machine In Docker Mode (Ecr Private Repo) Using Clearml. For Some Reason I Cannot Get This To Work With :

Hello,
Trying to figure out how to run a machine in docker mode (ECR private repo) using ClearML.
For some reason I cannot get this to work with :
None

I tried adding

sudo apt update
sudo apt install amazon-ecr-credential-helper

To the init script of the VM.
and also

environment {
  AWS_ACCESS_KEY_ID="****"
  AWS_SECRET_ACCESS_KEY="*****"
  AWS_DEFAULT_REGION="us-east-1"
}

under my credentials (Conf vault)
But I am still getting
docker: Error response from daemon: Get http:\****** : no basic auth credentials

  
  
Posted one year ago
Votes Newest

Answers 7


I see. Are you able to manually boot a VM on GCP and then manually SSHing into it and running the docker login command from there? Just to be able to cross out networking or permissions as possible issues.

  
  
Posted one year ago

Does it help to also run docker login in the init bash script?
You should be able to access your AWS credentials from the environment (the agent will inject them based on your config)

  
  
Posted one year ago

the environment setting you added to your vault is only applied inside the instance when the agent starts running there, not as part of the command that starts the instance.
The most common DevOps practice for having these kind of variables in the init script but not completely exposed to the naked eye is by adding something like

export MY_ENV_VAR=$(echo '<base64-encoded secret>' | base64 --decode)

to the init script (編集済み)

  
  
Posted one year ago

I tried.
it looks like this,

sudo apt update
sudo apt install amazon-ecr-credential-helper
aws ecr get-login-password --region us-east-1 | docker login --username AWS --password-stdin ****

But my problem is that I can't even see whether it passes my init script properly (tried to add printing comment but I cannot see the output) anywhere (nor scaler, nor task)

  
  
Posted one year ago

I think ClearML boots up only afterwards, so those environment variables may not be available yet.
You should set them manually in the bootstrap code unfortuantely.

  
  
Posted one year ago

Important to notice I am running my instances on GCP, but the container is on ECR (AWS)

  
  
Posted one year ago

You are right Idan,
I consulted our Private ClearML channel.
you cannot insert these environment variables any other place,
only in init script.
Here is the full quote:

  
  
Posted one year ago
761 Views
7 Answers
one year ago
one year ago
Tags