Isn't clearml local storage as well if needed?

Task.create right?

As we can’t create keys in our AWS due to infosec requirements

The minerva one is my custom package AgitatedDove14

Am I missing something?

Currently we train from Sagemaker notebooks, push models to S3 and create containers for model serving

Yeah that would be good

AgitatedDove14 - tried exit(0) from the notebook and it worked

I just run the k8s daemon with a simple helm chart and use it with terraform with the helm provider. Nothing much to share as it’s just a basic chart 🙂

Hey TimelyPenguin76 - i am just using the helm chart and haven’t done any setup on top of that. the agentservices is running as is from the helm chart

1.0.3. Tried with 1.0.5 as well

Ah ok. Kind of getting it, will have to try the glue mode

AgitatedDove14 you had mentioned some pipeline related changes coming, are they in?

What happens if I do blah/dataset_url ?

Would like to get to the Maturity Level 2 here

https://cloud.google.com/architecture/mlops-continuous-delivery-and-automation-pipelines-in-machine-learning#mlops_level_2_cicd_pipeline_automation

It might be better suited than execute remotely for your specific workflow 

Exactly

I get other things from the project like the dataset

As per - https://clear.ml/docs/latest/docs/references/sdk/task#connect

AgitatedDove14 - any thoughts?

What could those triggers be?

GrumpyPenguin23 both in general and clearml 🙂

or atleast a way to register these

Which would also mean that the system knows which datasets are used in which pipelines etc

Is there a good way to get the project of a task?

do not limit the clone on execute_remotely,

Yes

How is clearml-session intended to be used?

More interested in some way for doing this ssytem wide

close it

It’s a task, it’s running in context of a project, but I don’t have a way to get the project name

AgitatedDove14 ^^