I just called the script with:
task.set_base_docker(
docker_image="nvidia/cuda:11.7.0-runtime-ubuntu22.04",
# docker_arguments="--privileged -v /dev:/dev",
)
task.execute_remotely(queue_name="default")

Then in the console:
Exception: Command '['/usr/bin/python3', '-m', 'poetry', 'config', '--local', 'virtualenvs.in-project', 'true']' returned non-zero exit status 1. Error: Failed configuring Poetry virtualenvs.in-project failed installing poetry requirements: Command '['/usr/bin/python3', '-m', 'poetry', 'config', '--local', 'virtualenvs.in-project', 'true']' returned non-zero exit status 1.The agent tries to use poetry from python but it did not install it.
If I try to install poetry beforehand in the image, I get the dependency error above, if I install it with the installation script it makes no difference.