Hi CostlyOstrich36 basically, I'm using this code to create a pipeline https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_from_decorator.py
After I run the code. I can go to the ClearML server and click on "Pipelines" menu and see a new pipeline running, with a DAG graph showing all the steps.
Now I want to schedule it to run once a month. So in the main function, instead of calling execute_pipeline()
, I create a scheduler:from clearml.automation import TaskScheduler scheduler = TaskScheduler() scheduler.add_task( name='recurring pipeline', schedule_function=executing_pipeline, queue='default', day=1, month=1, target_project='My Project', execute_immediately=True ) scheduler.start_remotely(queue='default') scheduler.start()
This code create a task "Scheduler" running in project "DevOps". The scheduler will then run each steps of the pipeline itself.
So to me, it does not create the pipeline task under "Pipelines" menu, and no DAG graph. The pipeline is still run by the scheduler, so I still got the output of all the steps. I'm just wondering if I can change setting so it create the pipeline task under "Pipelines" menu, as if I manually run the execute_pipeline()
function.
Hi GrittyCormorant73 , can you please provide a standalone snippet with instructions to play with?