I can install the correct torch version with this command:
pip install --pre torchvision --force-reinstall --index-url ` None ```

It means that there is an issue with the drivers. I suggest trying this docker image - nvcr.io/nvidia/pytorch:23.04-py3

pip install --pre torchvision --force-reinstall --index-url None

docker="nvidia/cuda:11.8.0-base-ubuntu20.04"

I have set agent.package_manager.pip_version="" which resolved that message

I think it tries to get the latest one. Are you using the agent in docker mode? you can also control this via clearml.conf with agent.cuda_version

Thank you I will try that

I am trying task.create like so:

task = Task.create(
    script="test_gpu.py",
    packages=["torch"],
)

ERROR: This container was built for NVIDIA Driver Release 530.30 or later, but
       version 460.32.03 was detected and compatibility mode is UNAVAILABLE.

       [[System has unsupported display driver / cuda driver combination (CUDA_ERROR_SYSTEM_DRIVER_MISMATCH) cuInit()=803]]

In the config file it should be something like this: agent.cuda_version="11.2" I think

Collecting pip<20.2
Using cached pip-20.1.1-py2.py3-none-any.whl (1.5 MB)
Installing collected packages: pip
Attempting uninstall: pip
Found existing installation: pip 20.0.2
Not uninstalling pip at /usr/lib/python3/dist-packages, outside environment /usr
Can't uninstall 'pip'. No files were found to uninstall.