Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around

You have 2 options:

• set credential inside cleaml.conf : i am not familiar with this and never test it.
• or setup password less ssh with public key None

So the issue I am facing is, I am running the pipeline controller task on my local system agent and the steps of the pipeline on an agent running on GCP VM, the first step of the pipeline is failing showing clearml_agent: ERROR: Failed cloning repository.

because when I was running both agents on my local machine everything was working perfectly fine

This is probably you (or someone) had set up ssh public key with your git repo sometime in the past

because when I was running both agents on my local machine everything was working perfectly fine

Ok, it's cloning but it's asking for my github credentials

yes

you should be able to use as many agent as you want.
On the same or different queue

had you made sure that the agent inside GCP VM have access to your repository ? Can you ssh into that VM and try to do a git clone ?

Can you tell me how clearml get access to my repo even if I didn't pass any information about it?

(I never played with pipeline feature so I am not really sure that it works as I imagined ...)

with ssh public key, if from a terminal, I can do git clone, then so do the clearml agent, as it run on behalf of an local user. That apply to both local and VM

I use ssh public key to access to our repo ... Never tried to provide credential to clearml itself (via clearml.conf ) so I cannot help much here ...

one the same or different machine !

not sure how that work with Docker and machine that is not set up with ssh public key ... We will go to that path sometime in the future so I am quite interested too, on how people do it without ssh public key

there is a whole discussion about it here: None

so you mean when i ssh into my VM i need to do a git clone and then spin up the agent, right?

Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around

i need to do a git clone

You need to do it to test if it works. Clearml-agent will run it itself when it take in a task