Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi

Hi !
🎉 We have exciting news to share, clearml-serving v2 is finally out! 🎊

After multiple design iterations with users & customers, the new and revised clearml-serving is ready!
Deploy with a single docker-compose and have:

  • 📯 Out of the box ML serving
  • 💪 Triton backed DL serving
  • 🪄 Full support for per/post processing code (so now we have a simple RestAPI, no more application logic!)
  • 📊 OOB Performance Monitoring with Grafana Dashboard (Yes! including custom prediction histograms and inputs!)

https://github.com/allegroai/clearml-serving/ 🎁 https://github.com/allegroai/clearml-serving/

If you want to learn more on the design decisions and the architecture, check out ClearML serving GTC22 talk 🕶️ https://www.nvidia.com/gtc/session-catalog/?tab.scheduledorondemand=1583520458947001NJiE&search=S41459#/session/1637011020649001r8m6

  
  
Posted 2 years ago
Votes Newest

Answers 8


Awesome! any way to hear the talk w/o/ registering for the whole conference?

  
  
Posted 2 years ago

I think it is free 🙂 (registration that is)

  
  
Posted 2 years ago

BTW
Grafana Visualizing endpoint request latency as well as prediction result value distributions

  
  
Posted 2 years ago

Awesome! any way to hear the talk w/o/ registering for the whole conference?

CloudySwallow27 Anyway we will make sure we upload the talk to the clearml youtube channel after the Talk

  
  
Posted 2 years ago

gotit. reg is indeed free 🙂

  
  
Posted 2 years ago

This is so cool!

  
  
Posted 2 years ago

I missed this! nooooo. Please upload the talk

  
  
Posted 2 years ago

I think you can watch it after GTC on the nvidia website, and a week after that we will be able to upload it to the youtube channel 🙂

  
  
Posted 2 years ago
1K Views
8 Answers
2 years ago
one year ago
Tags