Ok the doc needs fix

The agent ip? Generally what’s the expected pattern to deploy and scale this for multiple models?

Awesome

AgitatedDove14 - i had not used the autoscaler since it asks for access key. Mainly looking for GPU use cases - with sagemaker one can choose any instance they want and use it, autoscaler would need set instance configured right? need to revisit. Also I want to use the k8s glue if not for this. Suggestions?

Generally like the kedro project and pipeline setup that I have seen so far, but haven’t started using it in anger yet. Been looking at clearml as well, so wanted to check how well these two work together

Task.add_requirements would fit the bill yeah, thanks

Maybe two thing here:

If Task.init() is called in an already running task, don’t reset auto_connect_frameworks? (if i am understanding the behaviour right) Option to disable these in the clearml.conf

Hope you don’t mind linking to that repo

yeah meant this, within clearml.conf:

logging {} sdk {}

Thanks let me try playing with these!

Thanks!

Now do Task.current_task() and it creates a new task

AgitatedDove14 - added it in bucket_config.py and sdk.conf but somehow value is not being picked up

How can I ensure that additional tasks aren’t created for a notebook unless I really want to?

But if haven’t done a task yet

I do it to get project name

Essentially, if I have a dataset on which I am performing transformations and then creating other downstream datasets

AgitatedDove14 - thanks for the quick reply. automation.Monitor is the abstraction i could use?

Is there some doc or relevant code on exactly what's happening? The behaviour has been random

The chart installs 0.17

https://github.com/allegroai/clearml-agent/blob/aede6f4bac71c8fc56e7cf982318a48527953a3c/clearml_agent/glue/k8s.py#L217

Nope, that doesn’t seem to be it. Will debug a bit more.

Ok, but doesn't work for me though. Can you or AgitatedDove14 help me in linking to relevant code so that I can see what's wrong?

Yeah got it, thanks!

Pushed - https://github.com/allegroai/clearml/pull/342/

It’s a bit difficult to figure out the exact key. Will try this to see if it works

SuccessfulKoala55 what’s the right way to do this using the SDK. I use Task.init but the option is there only in Task.create? (I have always been indecisive on when to use init vs create as well). Pointers?

Yeah sure

Thanks you! Does this go as a root logging {} element in the main conf? outside SDK right?

Anything I am missing