I was having this confusion as well. Did behavior for execute_remote change that it used to be Draft is Aborted now?

CynicalBee90 - on the platform agnostic aspect - dvc does it with the CLI right? It that what made you give a green checkmark for it?

dataset1 -> process -> dataset2

Optuna

Example:

name: ml-project template: nbdev pipelines_runner: gitlab pipelines: pipeline-1: steps: - name: "publish-datasets" task_script: "mlproject/publish_datasets.py" - name: "training" task_script: "mlproject/training.py" parents: ["publish-datasets"] - name: "test" task_script: "mlproject/test.py" parents: ["training"]Have cli which goes through each of the tasks and creates them

Any chance you can open a github issue on it?

Will do!

That’s great, will try it out soon (it’s 2.30am here, about to crash 🙂 )

Can I force add or something?

Ah is it, didn’t know about that. Let me check it out.

I guess the question is - I want to use services queue for running services, and I want to do it on k8s

from here: https://github.com/allegroai/clearml/blob/5a9155b2039413280f13dfded1121470c4c4323d/examples/pipeline/pipeline_controller.py#L29

yeah i was trying in local and it worked as expected. But in local I was creating a Task first and then seeing if it’s able to get project name from it

+1. The k8s helper needs to be more k8s native.

Basic question - i am running clearml agent in a ubuntu ec2 machine. Does it use docker by default? I thought it uses docker only if I add the --docker flag?

Pushed - https://github.com/allegroai/clearml/pull/342/

I don’t want to though. Will run it as part of a pipeline

Nothing in mind, just wanted to know if there was one 🙂

Also going off this 🙂

The GCP image and Helm chart for ClearML Server maybe slightly delayed for purely man-power reasons.

One more help - is this something I can pass as task_overrides when creating a pipeline in add_step?

I used .update_weights(path) with path being the model dir containing the model.py annd the config.pbtxt. Should I use update_weights_package ?

Got it thanks TimelyPenguin76 .

It’s a bit difficult to figure out the exact key. Will try this to see if it works

From code perspective what changes?

Will try it out. Pretty impressed 🙂

“notebook as a service” right

AgitatedDove14 - yeah wanted to see what’s happening before disabling as I wasn’t sure if this is what’s expected.

Thanks AgitatedDove14 - is the datasets feature pretty new?

Without some sort of automation on top feels a bit fragile

Sagemaker will make that easy, especially if I have sagemaker as the long tail choice. Granted at a higher cost