Hi @<1523701070390366208:profile|CostlyOstrich36> @<1523701087100473344:profile|SuccessfulKoala55> I had given a wrong queue. Everything works now. Sorry for the confusion. Have a nice day!
Hi @<1552101447716311040:profile|SteadySeahorse58> , if the experiment is still in pending mode it means that it wasn't picked up by any worker. Please note that in a pipeline you have the controller that usually runs on the services queue and then you have the steps where they all can run on different queues - depending on what you set
@<1552101447716311040:profile|SteadySeahorse58> continuing John's reply, what queue did you set the agent to monitor?
I restarted the agent and it picks the task and hangs at that log message i posted in the chat
Hi @<1523701070390366208:profile|CostlyOstrich36> , I am running the agent to listen to both queues: services and default queue
clearml-agent daemon --queue default services
Also, I set pipe.set_default_execution_queue("default")
in order to run pipeline steps in default queue and calling pipe.start()
to run the controller in services queue.
It seems more related to the pipeline setup/code
Can you share the pipeline code you're using?
Can you point to the exact piece of code?