That's cool AgitatedDove14 , will try it out and pester you a bit more. 🙂

Since it’s already logging this debug wouldn’t add anything?

That’s great, will try it out soon (it’s 2.30am here, about to crash 🙂 )

Doing this with one step - https://github.com/allegroai/clearml/blob/master/examples/pipeline/pipeline_controller.py

Will try set_parent, it wasn't in the docs and wasn't sure

If i were to push the private package to, say artifactory, is it possible to use that do the install?

SuccessfulKoala55 what’s the right way to do this using the SDK. I use Task.init but the option is there only in Task.create? (I have always been indecisive on when to use init vs create as well). Pointers?

Thanks

Awesome, thanks! Sorry missed it

This is for building my model package for inference

Get the imports, yes.

One more help - is this something I can pass as task_overrides when creating a pipeline in add_step?

What’s overrides_yaml vs template_yaml?

It’s a bit difficult to figure out the exact key. Will try this to see if it works

But it seems to make the current task the data processing task. I don't want it to take over the task.

It did pick it from the task?

Yeah got it, thanks!

Generally like the kedro project and pipeline setup that I have seen so far, but haven’t started using it in anger yet. Been looking at clearml as well, so wanted to check how well these two work together

AgitatedDove14 - does having this template work for updating hte base image:

` spec:
containers:

• image: nvidia/cuda:11.4.1-cudnn8-runtime-ubuntu20.04 `

Ah is it, didn’t know about that. Let me check it out.

Was able to use ScriptRequirements and get what I need. thanks!

Thanks for the fast responses as usual AgitatedDove14 🙂

That’s about what i do

Would adding support for some sort of post task script help? Is something already there?

yeah meant this, within clearml.conf:

logging {} sdk {}

I use a custom helm chart and terraform helm provider for these things

😕

This one - https://github.com/allegroai/clearml/blob/master/examples/optimization/hyper-parameter-optimization/hyper_parameter_optimizer.py

I only see published getting preference, not a way to filter only to published

Thanks CostlyOstrich36