Regarding the python version, the version used to run the local task is recorded on the task , and the agent will try to locate as close as possible python version when running the task remotely (from the python versions installed on the remote machine/docker image)
Can you share logs or different runs and explain what the code does in each? Are all your scripts running remotely using an agent?
Hi @<1600661428556009472:profile|HighCoyote66> , what exactly is the flow you're currently using? In ClearML, experiments are created on the server by running local code (allowing the ClearML SDK to capture their properties and dependencies) or alternatively using the clearml-task
CLI to create the task by specifying all properties and dependencies, than these experiments can be cloned and queued for remote execution - at this point, the agent running the task remotely can set up an environment and install all required dependencies.
From your description, I assume some dependencies are not installed, so I wonder how you've created the task and how you are running the agent to run the tasks remotely