Hi, does anyone faced this problem?
I'm trying to run a task from a queue. The same task is running locally just fine. Moreover, I have an experience running large scale of experiments from clearml's queues, this problem is new.
After setting the env, I get this output: Note: switching to 'f31af3927f4091f5fb8126c77a0addebd4c1fe94' (or any other random commit id) . Than it makes some more installations, and after the env summarization I get:
Environment setup completed successfully
Starting Task Execution:
/root/.clearml/venvs-builds/3.8/bin/python: can't open file 'run_with_clearml.py': [Errno 2] No such file or directory and it fails.
'run_with_clearml.py' is my running script, however it is not where it should be found.
Any help? I tried running on different machines, different accelerators (gpu\hpu) and I get this same error. clearml version= 1.13.2
Thanks!
Hey,
I attach the task's exec code, and the full log on gpu. And this is actually a semi-self deployed project. Thanks!
Hi @<1531807732334596096:profile|ObliviousClams17> , are you self deployed? Can you please provide the full log?
What happens if you clear the commit and just run with latest master?
Yes, this is the file I attached (the png)
Is run_with_clearml.py your own file?
@<1531807732334596096:profile|ObliviousClams17> can you share a screenshot of the task's execution section?
