Are you running the agent on the same machine as the server?

no, my server is on aws and agent is local

CostlyOstrich36 any idea what could be going wrong here?
OR do you have any example of this type of setup?

my code to init task:

task.set_base_docker(
    docker_image="clearml",
    docker_arguments=(
        "-d "
        f"-v {PWD}data:/home/data "
        f"-v {PWD}.passwd-s3fs:/home/.passwd-s3fs "
        f"-v {PWD}.logger_credentials:/home/.logger_credentials "
        "-v /home/$USER/.ssh/:/root/.ssh/ "
        "--rm "
        "--net=host "
        "--privileged "
        "--gpus all "
    )
)

task.set_script(
    entry_point="scripts/evaluate.py"
)

Hi BewilderedDove91 , please provide a full log of the execution