What happens if you comment or remove the pipe.set_default_execution_queue('default')
and use run_locally
instead of start_locally
?
Because in the current setup, you are basically asking to run the pipeline controller task locally, while the rest of the steps need to run on an agent machine. If you do the changes I suggested above, you will be able to run everything on your local machine.
Hi, thanks of the reply
when I remove pipe.set_default_execution_queue('default')
i get
ValueError: Node 'step_one_sp' missing execution queue, no default queue defined and no specific node queue defined
Ok, then launch an agent using clearml-agent daemon --queue default
that way your steps will be sent to the agent for execution. Note that in this case, you shouldn't change your code snippet in any way.
AttributeError: 'PipelineController' object has no attribute 'run_locally'
@<1537605940121964544:profile|EnthusiasticShrimp49> I don't have start_locally
The line before the last in your code snippet above. pipe.start_locally
.