thank CostlyOstrich36 so should I point the clearml-agent to listen to "services" queue instead of "default" queue? Would it be able to process the pipeline steps?
If I understand correctly, the agent will spin additional pod to run the steps in the pipeline, right?

Also just another question: How do I set the git credential for the agent? In the values file https://github.com/allegroai/clearml-helm-charts/blob/main/charts/clearml-agent/values.yaml
look like I can set git user and pass, but can I set ssh key instead?

Hi PunyWoodpecker71 ,

It's best to run the pipeline controller in the services queue because the assumption is that the controller doesn't require much compute power as opposed to steps that can be resource exhausting (depends on pipeline of course)