Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Guys, My Git Repo Is Installed With Its Python Dependencies Inside A Local Docker Image. Is It Possible To Run My Docker Image On Aws Autoscaler And Skip The Venv That Clearml Agent Installs?

Hi guys,

My git repo is installed with its python dependencies inside a local docker image. Is it possible to run my docker image on aws autoscaler and skip the venv that clearml agent installs?

  
  
Posted one year ago
Votes Newest

Answers 5


Check out the agent environment variables, you have one there the allows you to specify the python binary and bypass any installation - this flag should be passed into the docker image

  
  
Posted one year ago

Hi, could you please be more specific? It is hard to guess how to configure things without a specific example. Isn't there any clearml.conf example that does this? I thought it is a common case....
I'm creating a new autoscaler instance, where should configure all this? in the extra configuration section? to write a custom .conf file and put it there?

  
  
Posted one year ago

You can use the autoscaler init script to issue a docker login command

  
  
Posted one year ago

See here - specifically CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL
You'll need to make sure this env var is set before execution starts (you can set that in the custom bash script for the autoscaler instances).
This is actually not a very common scenario since the agent is designed to recreate the environment on the fly, building a docker image containing everything is not required, takes time and should be done again every time you need to change something, so we recommend just specifying your requirements and letting the agent do the work 🙂

  
  
Posted one year ago

Hi thanks,
It did help.
My problem is now that the agent running on aws can't find my docker image (which is stored in AWS ECR private repo).
How can I give it access to ecr? I haven't seen any key-value in the conf sdk.aws section that talks about authenticating to ECR.

  
  
Posted one year ago