i found the issue. I need to pass the queue name to pipe.start() as
pipe.start(queue="default")
I thought setting the default execution already takes care of this.
Hi @<1552101447716311040:profile|SteadySeahorse58>
ValueError: Could not find queue named "services"
Did you set an agent / auto-scaler ? where is the pipeline and its components will be running ?
If you are using the "default" queue for the agent, notice you might need to run the agent with --services-mode
to allow for multiple pipeline components on the same machine
By default, the queue is set to "services" in the start() method