Hey @<1523701070390366208:profile|CostlyOstrich36> , do you know of a way to use Podman instead of Docker?
Unfortunately I don't think I can run in --docker
mode, I'm on a RHEL 8 system which only supports podman (sucks I know but it's a university thing), is there any other options? I was thinking if there was some way to pull the python version from task metadata I could dynamically craete/reuse conda envs with the right environment.
Ok thanks I'll look into that! I'm still wondering though, is there no endpoint that returns info on the python executable? I went through ClearML Task endpoints and ClearML api client for tasks as well and I couldn't find one that returns the environment, e.g. the python executable or like a requirements.txt of the experiment. Is there something I am overlooking? Or are is this information not yet available to the ClearML SDK?
Hi @<1600661428556009472:profile|HighCoyote66> , ClearML Agent will try to find the python version dynamically and then revert to most basic one it can find. My suggestion is to run everything in docker mode ( --docker
) so the python version can be set by the docker