Hi everyone!

I have a question about the pipeline controller: I would like to build a ml pipeline similar to the one at https://allegro.ai/clearml/docs/docs/examples/pipeline/pipeline_controller.html with the difference that instead of manually calling python to execute the python scripts for each step I'd like to create each task from a single script.

So what I'm doing is, before instantiating the pipeline controller, I use several Task.create() to create a task for each one of the pipeline steps, giving as input the related scripts in a git repository. After this I can execute the pipeline without problems since the tasks are now present on the ClearML server. The problem is that on the ClearML UI, each time I run this pipeline script I have both 'draft' tasks for each step and also 'completed' tasks for each step. I would like to know if there is a I way to generate only the 'completed' tasks to keep the UI more clean and less confusing. I'm new to ClearML so please tell if I'm using a wrong approach or there could be an easier way.

Thank you 🙂