So the issue I am facing is, I am running the pipeline controller task on my local system agent and the steps of the pipeline on an agent running on GCP VM, the first step of the pipeline is failing showing clearml_agent: ERROR: Failed cloning repository.

you should be able to use as many agent as you want.
On the same or different queue

(I never played with pipeline feature so I am not really sure that it works as I imagined ...)

not sure how that work with Docker and machine that is not set up with ssh public key ... We will go to that path sometime in the future so I am quite interested too, on how people do it without ssh public key

Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around

You have 2 options:

• set credential inside cleaml.conf : i am not familiar with this and never test it.
• or setup password less ssh with public key None

because when I was running both agents on my local machine everything was working perfectly fine

This is probably you (or someone) had set up ssh public key with your git repo sometime in the past

Do I need not make changes into clearml.conf so that it doesn't ask for my credentials or is there another way around

yes

because when I was running both agents on my local machine everything was working perfectly fine

i need to do a git clone

You need to do it to test if it works. Clearml-agent will run it itself when it take in a task

so you mean when i ssh into my VM i need to do a git clone and then spin up the agent, right?

Ok, it's cloning but it's asking for my github credentials

one the same or different machine !

I use ssh public key to access to our repo ... Never tried to provide credential to clearml itself (via clearml.conf ) so I cannot help much here ...

there is a whole discussion about it here: None

Can you tell me how clearml get access to my repo even if I didn't pass any information about it?

with ssh public key, if from a terminal, I can do git clone, then so do the clearml agent, as it run on behalf of an local user. That apply to both local and VM

had you made sure that the agent inside GCP VM have access to your repository ? Can you ssh into that VM and try to do a git clone ?