obviously 🙂

open to being totally wrong 🙂

The takeaway from the pricing page, I think, is that clearml is free as in speech. If you want super duper support that may cost $ but the folks in the community here do an awesome job in the meantime.

loving it .. thanks for the suggestion.. I am trying to build up a roadmap, so thank you for the idea

❤ 👍

honestly.. I think google are "fine" with it.. there are plenty of other (more egregious) abuses of their colab and they haven't screamed yet.

if you manage to get it up and running, I would love to do a deep dive with you to understand how you did and share it on the company's blog 🙂 🙂

no pressure 😜

laughs okily dokily Sir.. noted and noted 👍
I must admit, I have been using plotly and matplotlib for years and.. I have never used animations once. I am old school though 🙂

👍

Sadly, I haven't, but if anyone has then please scream because I would love to pick your brain for (yet another) post/article I am writing 😄 😄

I take it you are wanting to use Airflow to replace/extend an existing Jenkins setup ??

Hey Leandro, I don't think it will work with replacing elasticserver with the AWS service type 😕

SubstantialElk6 I am having a bit of a monday morning (on a wednesday, not good)

since python is running inside a docker/cri-o/containerd in k8s anyway, what would you gain from using the installed global python libraries ?? Any libs would have to be installed at container time anyway so.. urm. yeah.

feel free to treat me like an idiot and use small words to explain, I honestly don't mind 🙂 I could be missing something in your use case (more than likely)

So those datasets are the same but.. yes.. it's squashed/warped

the part that I am concerned on is that the first pair of graphs you showed, the dataset (even from jst looking at it) are very different 😕

the one on the right, for example, has no data points at around the 19 mark

I may have to let someone with more know-how on the histogram and graphing answer if there is anyway to change graph layout though

Hello E.K, do you have any examples handy to show us the difference ?

Hey Federico, since you are doing this from inside python, you could always call the 'get_parameters_as_dict' from the Task you have cloned, merge/update whichever ones you want to (or not), and then call ' set_parameters_as_dict ' .. I believe that should get you where you want to go 🙂

the one you are in 🙂

the brain surface viewer (more dash than anything) .. jst.. wow

👍

so yes indeedly ..

sudo find /var/lib/ -type d -exec du -s -x -h {} \; | grep G | more

seems to give saner results.. of course, in your case, you may also want to grep M for megabyte

I believe you can set it on a 'per container' way as well.

@<1687643893996195840:profile|RoundCat60> you set it once, inside the docker-compose itself.. it will affect all docker containers but, to be honest, docker tends to log everything

Shameless plug here ; https://clear.ml/blog/jupyter-notebooks-used-as-clearml-workers/

this whole area is a WIP of course, but I am trying to capture some of the really interesting Q and A from here so that they don't jst disappear into the void 🙂

I would assume, from the sounds of it, that you are using the dockerfile to pip install python libs.. In which case a pip install clear-ml can also be done at image creation time.. I don't know what other methods you would be using to install python deps.. Easy_install?!?

You may also want to brush up on the security and firewalls for AWS.. those always seem to be voodoo as far as I can tell 😄

oh .. no worries at all then.. you are free to do whatever you want to with it.. but I don't think it's designed with what you are trying to do in mind sadly

you can cut steak with a spoon, but that doesn't mean it's a good idea 😉 😉

I know the storage can be swapped out to using S3 (obviously)