Thanks DeliciousBluewhale87 , setting up with k8s is definitely a good suggestion!

Okay, I'll make a channel here today, and the sticky post on it would be a list of other channels 💪

For now here is one of my favorites:

https://discord.gg/v4BfukdZ

https://clearml.slack.com/archives/C025C2J8XU5/p1623963856000700

Hi SubstantialElk6 , have a look at Task.execute_remotely, and it's especially for that. For instance in the recent webinar, I used pytorch-cpu on my laptop and task.execute_remotely. the agent automatically installs the GPU version. Example https://github.com/abiller/events/blob/webinars/webinars/flower_detection_rnd/A1_dataset_input.py

Hi, it is under construction, but it is going to be there.

SuccessfulKoala55

Cool. I found Logger.tensorboard_single_series_per_graph()

You rang?

Totally within ClearML :the_horns: :the_horns:

Hi Dan, please take a look at this answer, the webapp interface mimics this. Does this click for you?

https://clearml.slack.com/archives/CTK20V944/p1620026745273800?thread_ts=1619069712.095300&channel=CTK20V944&message_ts=1620026745.273800

Hi! Looks like all the processes are calling torch.save so it's probably reflecting what Lightning did behind the curtain. Definitely not a feature though. Do you mind reporting this to our github repo? Also, are you also getting duplicate experiments?

We need SEO for our docs 😉

horray for the new channel ! you are all invited

That's interesting, how would you select experiments to be viewed by the dashboard?

ClearML thanks

Hi, this really depends on what your organisation agrees is within MLOps control and what isn't. I think this blogpost is a must read:
https://laszlo.substack.com/p/mlops-vs-devops
and here is a list of infinite amount of MLOps content:
https://github.com/visenger/awesome-mlops
Also, are you familiar with the wonderful MLOPS.community? The meetup and podcasts are magnificent (also look for me in their slack)
https://mlops.community/

ClearML Free or self-hosted?

https://clear.ml/docs/latest/docs/guides/reporting/plotly_reporting ?

I'm not sure I can help with the technicality, but here is a basic question you'll be aksed - are you able to download anything from your minio using ClearML?

There are several ways of doing what you need, but none of them are 'magical' like we pride ourselves for. For that, we would need user input like yours in order to find the commonalities.

@<1523714910930866176:profile|MiniatureStarfish88> if you are here make sure to vote for the next presentor of my show ^

Well in general there is no one answer. I can talk about it for days. In ClearML the question is really a non issue since of you build a pipeline from notebooks on your dev in r&d it is automatically converted to python scripts inside containers. Where shall we begin? Maybe you describe your typical workload and intended deployment with latency constraints?

Hmm, anything -m will solve? https://docs.docker.com/config/containers/resource_constraints/
or is it a segfault inside the container becuase ulimit isn't set to -s unlimited ?

Well, we had a nice video from twimlcon but it is not up yet on our site. I recently gave a very long demo on both basic and semi-advanced clearml usage - you can watch it here
https://youtu.be/VJJsVJiWnYY?t=1774
the slides are here:
https://docs.google.com/presentation/d/1PFPTQkHVGxugruTRFDnuVmS85ziSbNOTixCVQwPMFDI/edit?usp=sharing
code is here:
https://github.com/abiller/events/tree/webinars/webinars/flower_detection_rnd

Oh hey, did someone mention my name on this thread? MiniatureCrocodile39 did you manage to create a pycharm virtual env with clearml installed?

There are an astounding number of such channels actually. It probably depends on your style. Would you like me to recommend some?

Of course we can always create a channel here as well... One more can't hurt 😉

Thanks @<1523701205467926528:profile|AgitatedDove14> , also I think you're missing a few pronouns there 😉

I'm all for more technical tutorials for doing that... all of this fits the clearml methodology

I think the most up-to-date documentation for that is currently on the github repo, right SuccessfulKoala55 ?
https://github.com/allegroai/clearml-server-helm

First of all I'd like to thank you for pointing out that our messaging is confusing. We'll fix that.

To the point: Nice interface and optimized db access for feature stores is part of our paid, enterprise offering.

Managing data/features as part of your pipelines and getting version-controlled features == offline feature store

The latter is doable with the current ClearML open source tools, and I intend to show it very soon. But right now you won't have a different pane for DataOps, it'll...