Experiment Environment Containers Tutorial :
I create a docker image with:

$ clearml-agent build --id d8162747eb2d4453bba9778851d1e120 --docker --target new_docker
[...]
Running in Docker mode (v19.03 and above) - using default docker image: nvidia/cuda:12.1.1-runtime-ubuntu22.04 

Building Task d8162747eb2d4453bba9778851d1e120 inside docker image: nvidia/cuda:12.1.1-runtime-ubuntu22.04  setup_script=

Starting docker build

==========
== CUDA ==
==========

CUDA Version 12.1.1
[...]
root@ef7c1dafe836:/# 
Docker build done
Committing docker container to: /data/hieu/deleteme/new_docker
None

Then start the agent (on that same PC) with:

$ clearml-agent daemon --docker --queue default

[...]

+----------------------------------+---------+-------+
| id                               | name    | tags  |
+----------------------------------+---------+-------+
| 43ff6bb15fa2496aa3e0624d306c8ed0 | default |       |
+----------------------------------+---------+-------+

Running in Docker mode (v19.03 and above) - using default docker image: nvidia/cuda:12.1.1-runtime-ubuntu22.04 

Running CLEARML-AGENT daemon in background mode, writing stdout/stderr to /tmp/.clearml_agent_daemon_outtd0rgrw7.txt

In the UI (hosted locally), clone my task, change the Container image, queue the task. then the console show:

2023-06-07 13:15:07
task 030251abac2b4df28af3b09235b7d845 pulled from 43ff6bb15fa2496aa3e0624d306c8ed0 by worker hieuOpensuse:0
2023-06-07 13:15:08
Running Task 030251abac2b4df28af3b09235b7d845 inside docker: new_docker arguments: []
2023-06-07 13:15:08
Executing: ['docker', 'run', '-t', '--gpus', 'all', '-l', 'clearml-worker-id=hieuOpensuse:0', '-l', 'clearml-parent-worker-id=hieuOpensuse:0', '-e', 'CLEARML_WORKER_ID=hieuOpensuse:0', '-e', 'CLEARML_DOCKER_IMAGE=new_docker', '-e', 'CLEARML_TASK_ID=030251abac2b4df28af3b09235b7d845', '-v', '/home/mhtrinh/.gitconfig:/root/.gitconfig', '-v', '/tmp/.clearml_agent.p16m_v3j.cfg:/tmp/clearml.conf', '-e', 'CLEARML_CONFIG_FILE=/tmp/clearml.conf', '-v', '/tmp/clearml_agent.ssh.lasswt22:/.ssh', '-v', '/home/mhtrinh/.clearml/apt-cache:/var/cache/apt/archives', '-v', '/home/mhtrinh/.clearml/pip-cache:/root/.cache/pip', '-v', '/home/mhtrinh/.clearml/pip-download-cache:/root/.clearml/pip-download-cache', '-v', '/home/mhtrinh/.clearml/cache:/clearml_agent_cache', '-v', '/home/mhtrinh/.clearml/vcs-cache:/root/.clearml/vcs-cache', '-v', '/home/mhtrinh/.clearml/venvs-cache:/root/.clearml/venvs-cache', '--rm', 'new_docker', 'bash', '-c', 'echo \'Binary::apt::APT::Keep-Downloaded-Packages "true";\' > /etc/apt/apt.conf.d/docker-clean ; chown -R root /root/.cache/pip ; export DEBIAN_FRONTEND=noninteractive ; export CLEARML_APT_INSTALL="$CLEARML_APT_INSTALL libsm6 libxext6 libxrender-dev libglib2.0-0" ; cp -Rf /.ssh -T ~/.ssh ; [ ! -z $(which git) ] || export CLEARML_APT_INSTALL="$CLEARML_APT_INSTALL git" ; declare LOCAL_PYTHON ; [ ! -z $LOCAL_PYTHON ] || for i in {15..5}; do which python3.$i && python3.$i -m pip --version && export LOCAL_PYTHON=$(which python3.$i) && break ; done ; [ ! -z $LOCAL_PYTHON ] || export CLEARML_APT_INSTALL="$CLEARML_APT_INSTALL python3-pip" ; [ -z "$CLEARML_APT_INSTALL" ] || (apt-get update -y ; apt-get install -y $CLEARML_APT_INSTALL) ; [ ! -z $LOCAL_PYTHON ] || export LOCAL_PYTHON=python3 ; $LOCAL_PYTHON -m pip install -U "pip<20.2 ; python_version < \'3.10\'" "pip<22.3 ; python_version >= \'3.10\'" ; $LOCAL_PYTHON -m pip install -U clearml-agent ; cp /tmp/clearml.conf ~/default_clearml.conf ; NVIDIA_VISIBLE_DEVICES=all $LOCAL_PYTHON -u -m clearml_agent execute --disable-monitoring  --id 030251abac2b4df28af3b09235b7d845']
2023-06-07 13:15:13
Unable to find image 'new_docker:latest' locally
docker: Error response from daemon: pull access denied for new_docker, repository does not exist or may require 'docker login': denied: requested access to the resource is denied.
See 'docker run --help'.
2023-06-07 13:15:13
Process failed, exit code 125

I don't see the docker image new_docker in docker image list . Is this normal ?