Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello All, I'M Trying To Run A Few Pipeline Tasks Remotely Via A Private Docker Image But Struggling To Find Any Documentation On How/Where The

Hello all, I'm trying to run a few pipeline tasks remotely via a private docker image but struggling to find any documentation on how/where the docker login command can be ran before pulling. I'm getting an error along the following lines when the task tries to pull:

Unable to find image 'xxxxxx.dkr.ecr.eu-west-2.amazonaws.com/name:latest' locally
docker: Error response from daemon: Head "
": no basic auth credentials.

Any suggestions on how to run something like this before pulling:

aws ecr get-login-password --region eu-west-2 | docker login --username $USER --password-stdin $AWS_ECR_URL

?

  
  
Posted one year ago
Votes Newest

Answers 9


Not sure if ClearML has any built in support, but we used the above for a similar issue but with Prefect2 :)

  
  
Posted one year ago

Took some time to get extra_vm_bash_script set up properly but that's done the job!

Thank you again for the help!

  
  
Posted one year ago

Cool I'll let you know how it goes 🙂

  
  
Posted one year ago

That's all set up and handy to use locally but I can't see that there's any ClearML support for it. Nor can I think of any way of getting the binary into an instance span up by my auto scaler...

Maybe there's something I can change in the aws autoscaler example

  
  
Posted one year ago

Literally just opened that page as your message came through!

Great to know I'm going in the right direction, I'll give it a go, thanks!

  
  
Posted one year ago

(the extra_vm_bash_script is what you're after)

  
  
Posted one year ago

Well you can install the binary in the additional start up commands.
Matter of fact, you can just include the ECR login in the "startup steps" offered by the scaler, so no need for this repository. I was thinking these are local instances.

  
  
Posted one year ago

Nice one, thank you very much!

  
  
Posted one year ago