Hi !
🎉 We have exciting news to share, clearml-serving v2 is finally out! 🎊

After multiple design iterations with users & customers, the new and revised clearml-serving is ready!
Deploy with a single docker-compose and have:

• 📯 Out of the box ML serving
• 💪 Triton backed DL serving
• 🪄 Full support for per/post processing code (so now we have a simple RestAPI, no more application logic!)
• 📊 OOB Performance Monitoring with Grafana Dashboard (Yes! including custom prediction histograms and inputs!)

https://github.com/allegroai/clearml-serving/ 🎁 https://github.com/allegroai/clearml-serving/

If you want to learn more on the design decisions and the architecture, check out ClearML serving GTC22 talk 🕶️ https://www.nvidia.com/gtc/session-catalog/?tab.scheduledorondemand=1583520458947001NJiE&search=S41459#/session/1637011020649001r8m6