As the verify param was deprecated and now removed

Yeah, Curious - is a lot of clearml usecases not geared for notebooks?

Ok code suggests so. Looking for more powerful pipeline scheduling like on datasets publish, actions on model publish etc

AgitatedDove14 - any doc yet for scheduler? Is it essentially for just time based scheduling?

🙏

Thanks AnxiousSeal95

Having a pipeline controller and running actually seems to work as long as i have them as separate notebooks

PipelineController with 1 task. That 1 task passed but the pipeline says running

This is a Sagemaker notebook instances - Python 3.6.13

Also the pipeline ran as per this example - https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_controller.py

I would prefer controlled behavior than some available version being used. Here triggered a bunch of jobs that all went fine and even evaluations were fine and then when we triggered a inference deploy it failed

In this case, particularly because of pickle protocol version between 3.7 and 3.8

that or in clearml.conf or both

I just run the k8s daemon with a simple helm chart and use it with terraform with the helm provider. Nothing much to share as it’s just a basic chart 🙂

I use a custom helm chart and terraform helm provider for these things

This is the command that is running:

` ['docker', 'run', '-t', '-e', 'NVIDIA_VISIBLE_DEVICES=none', '-e', 'CLEARML_WORKER_ID=clearml-services:service:c606029d77784c69a30edfdf4ba291a5', '-e', 'CLEARML_DOCKER_IMAGE=', '-v', '/tmp/.clearml_agent.72r6h9pl.cfg:/root/clearml.conf', '-v', '/root/.clearml/apt-cache:/var/cache/apt/archives', '-v', '/root/.clearml/pip-cache:/root/.cache/pip', '-v', '/root/.clearml/pip-download-cache:/root/.clearml/pip-download-cache', '-v', '/root/.clearml/cache:/clea...

Hey TimelyPenguin76 - i am just using the helm chart and haven’t done any setup on top of that. the agentservices is running as is from the helm chart

The image to run is empty essentially

Lot of time had passed though

The console output in the UI says done but the pipeline is still “running”

Any idea why the Pipeline Controller is Running despite the task passing?

AgitatedDove14 - tried exit(0) from the notebook and it worked

Why do you think?

Doing this with one step - https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_controller.py

That’s great, will try it out soon (it’s 2.30am here, about to crash 🙂 )

Maybe related to doing in notebook. Doing a task.close() finished it as expected

Got it, makes sense on that part!