Was trying to figure out how the method knows that the docker image ID belongs to ECR. Do you have any insight into that?
Basically you should have the docker service login before running the agent, then the agent uses docker to run the image from the ECR.
Make sense ?
Sorry, just revisiting this as I'm only getting around to implementation now. How do you pass the ECR container ID to the defined task?
ECR access should be enabled as part of the role the agent instance assumes when it runs a task
Oh great, thanks! Was trying to figure out how the method knows that the docker image ID belongs to ECR. Do you have any insight into that?
And how will it know that the container is on ECR instead of some other container repository?
TenseOstrich47 as long as on the machine running the agent has credentials to your ECR, when the agent will run Any docker container, it will able to pull it. There is no need to manually change anything, notice the Task itself contains the name of the image it will use
Hi Max
you can configure a clearml agent to pull your docker image from ECR and run the experiment into it. Is that answering your question ?
yes it does, but that requires me to manually create a new agent every time I want to run a different env no?
TenseOstrich47 , you can specify a docker image withtask.set_base_docker(docker_image="<DOCKER_IMAGE>")
You will of course need to login to ECR on that machine so it will be able to download the docker image.