that worked, thanks AgitatedDove14

On a related note - is it possible to get things like ${stage_data.artifacts.dataset.url} from within a task rather than passing params in add_step ?

Having a pipeline controller and running actually seems to work as long as i have them as separate notebooks

Name is default None though?

+1. The k8s helper needs to be more k8s native.

Got the engine running.

curl <serving-engine-ip>:8000/v2/models/keras_mnist/versions/1What’s the serving-engine-ip supposed to be?

I am on 1.0.0

This is so cool!

As the verify param was deprecated and now removed

No, all of them completed!

This is a Sagemaker notebook instances - Python 3.6.13

PipelineController with 1 task. That 1 task passed but the pipeline says running

AgitatedDove14 - apologies for late reply. So to give context this in a Sagemaker notebook which has conda envs.

I use a lifecycle like this to pip install a package (a .tar.gz downloaded from s3) in a conda env- https://github.com/aws-samples/amazon-sagemaker-notebook-instance-lifecycle-config-samples/blob/master/scripts/install-pip-package-single-environment/on-start.sh

In the notebook I can do things like create experiments and so on. Now the problem is in running the cloned experimen...

Got it, makes sense on that part!

AgitatedDove14 - i had not used the autoscaler since it asks for access key. Mainly looking for GPU use cases - with sagemaker one can choose any instance they want and use it, autoscaler would need set instance configured right? need to revisit. Also I want to use the k8s glue if not for this. Suggestions?

A channel here would be good too 🙂

But I don’t see a task option in Dataset.create

https://github.com/allegroai/clearml/blob/master/clearml/datasets/dataset.py#L657-L663

Hey SuccessfulKoala55 Like I mentioned, I have a spacy ner model that I need to serve for inference.

Ok that wasn’t it 😞

Hope you don’t mind linking to that repo

Ok code suggests so. Looking for more powerful pipeline scheduling like on datasets publish, actions on model publish etc

1.0.3

Pushed the changes, not sure if it’s fully right. Do let me know. But functionality is working

Not really right? They deprecated a param which wasn’t removed in that commit i mentioned above

Or in the code? - https://github.com/allegroai/clearml/blob/master/clearml/task.py

Oh yeah I wanted to update only for the gpu stuff for now

Ok got it, thanks

This worked, thanks.

Sounds great!

Is nested projects in the release? I see it in the community server but no mention in the blog or the release notes?

that or in clearml.conf or both