Reputation
Badges 1
92 × Eureka!you are forcing ssh with force_git_ssh_protocol: true
Have you setup ssh keys ?
If you are using ssh keys, why enable_git_ask_pass: true
?
but then it still missing a bunch of library in the Taks (that succeed) > Execution > INSTALLED PACKAGES
So when I do a clone of that task, and try to run the clone, the task fail because it is missing python package 😞
interesting, the issue happen with mamba
venv. Now I use a python native venv and it is detecting correctly
is task.add_requirements("requirements.txt")
redundant ?
Is ClearML always look for a requirements.txt
in the repo root ?
one the same or different machine !
Ok. Found the solution.
The importance is to use this:
Task.add_requirements("requirements.txt")
task = Task.init(project_name='hieutest', task_name='foo',reuse_last_task_id=False)
And not:
task = Task.init(project_name='hieutest', task_name='foo',reuse_last_task_id=False)
task.add_requirements("requirements.txt")
that format is correct as I can run pip install -r requirements.txt
using the exact same file
and in the train.py
, I have task.add_requirements("requirements.txt")
there is a whole discussion about it here: None
you should be able to use as many agent as you want.
On the same or different queue
not sure how that work with Docker and machine that is not set up with ssh public key ... We will go to that path sometime in the future so I am quite interested too, on how people do it without ssh public key
Are you running within a zero-trust environment like ZScaler ?
Feels like your issue is not ClearML itself, but issue with https/SSL and certificate from your zero-trust system
while the other may need to be 1
instead of true
You are using CLEARML_AGENT_SKIP_PYTHON_ENV_INSTALL the wrong way
CLEARML_AGENT_SKIP_PIP_VENV_INSTALL need to be a path
so what was the solution/hack then ?
yup, you have the flexibility and option, that what so nice with ClearML
we are usign mmsegmentation by the way
got it
Thanks @<1523701070390366208:profile|CostlyOstrich36>
with ssh public key, if from a terminal, I can do git clone, then so do the clearml agent, as it run on behalf of an local user. That apply to both local and VM
What should I put in there? What is the syntax for git package?
most of people probable wont even know what that do