Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Hello all, I'm trying to run a few pipeline tasks remotely via a private docker image but struggling to find any documentation on how/where the docker login command can be ran before pulling. I'm getting an error along the following lines when the task tries to pull:

Unable to find image 'xxxxxx.dkr.ecr.eu-west-2.amazonaws.com/name:latest' locally
docker: Error response from daemon: Head "
": no basic auth credentials.

Any suggestions on how to run something like this before pulling:

aws ecr get-login-password --region eu-west-2 | docker login --username $USER --password-stdin $AWS_ECR_URL

?

  
  
Posted 2 years ago
Votes Newest

Answers 9


Cool I'll let you know how it goes 🙂

  
  
Posted 2 years ago

Literally just opened that page as your message came through!

Great to know I'm going in the right direction, I'll give it a go, thanks!

  
  
Posted 2 years ago

Took some time to get extra_vm_bash_script set up properly but that's done the job!

Thank you again for the help!

  
  
Posted 2 years ago

Nice one, thank you very much!

  
  
Posted 2 years ago

That's all set up and handy to use locally but I can't see that there's any ClearML support for it. Nor can I think of any way of getting the binary into an instance span up by my auto scaler...

Maybe there's something I can change in the aws autoscaler example

  
  
Posted 2 years ago

(the extra_vm_bash_script is what you're after)

  
  
Posted 2 years ago

Not sure if ClearML has any built in support, but we used the above for a similar issue but with Prefect2 :)

  
  
Posted 2 years ago

Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.

  
  
Posted 2 years ago