i need to do a git clone
You need to do it to test if it works. Clearml-agent will run it itself when it take in a task
Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around
You have 2 options:
- set credential inside cleaml.conf : i am not familiar with this and never test it.
- or setup password less ssh with public key None
I use ssh public key to access to our repo ... Never tried to provide credential to clearml itself (via clearml.conf
) so I cannot help much here ...
because when I was running both agents on my local machine everything was working perfectly fine
This is probably you (or someone) had set up ssh public key with your git repo sometime in the past
Can you tell me how clearml get access to my repo even if I didn't pass any information about it?
you should be able to use as many agent as you want.
On the same or different queue
So the issue I am facing is, I am running the pipeline controller task on my local system agent and the steps of the pipeline on an agent running on GCP VM, the first step of the pipeline is failing showing clearml_agent: ERROR: Failed cloning repository.
there is a whole discussion about it here: None
because when I was running both agents on my local machine everything was working perfectly fine
Ok, it's cloning but it's asking for my github credentials
not sure how that work with Docker and machine that is not set up with ssh public key ... We will go to that path sometime in the future so I am quite interested too, on how people do it without ssh public key
(I never played with pipeline feature so I am not really sure that it works as I imagined ...)
Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around
so you mean when i ssh into my VM i need to do a git clone and then spin up the agent, right?
with ssh public key, if from a terminal, I can do git clone, then so do the clearml agent, as it run on behalf of an local user. That apply to both local and VM
had you made sure that the agent inside GCP VM have access to your repository ? Can you ssh into that VM and try to do a git clone ?