Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Is There A Tutorial For Clearml Serving? I Followed The Steps On Its Repo But I Still Don'T Understand It. Also The Serving Engine Keeps Failing After A While. I Also Don'T Know How To Access The Serving Engine Or How To Send Inference Requests To It.

Is there a tutorial for ClearML Serving? I followed the steps on its repo but I still don't understand it. Also the serving engine keeps failing after a while. I also don't know how to access the serving engine or how to send inference requests to it.

  
  
Posted 2 years ago
Votes Newest

Answers 8


I've finally gotten the triton engine to run. I'll be going through nvidia triton docs to find how to make an inference request. If you have an example inference request, I'll appreciate if you can share it with me.

  
  
Posted 2 years ago

Do you have a log of the triton server?

  
  
Posted 2 years ago

Also the tutorial mentioned serving-engine-ip as a variable but I have no idea what the ip of the serving engine is.

  
  
Posted 2 years ago

Hi Fawad, maybe this can help you get started! They're both c++ and python examples of triton inference. Be careful though, the pre and postprocessing used is specific to the model (in this case yolov4) and you'll have to change it to your own model's needs

  
  
Posted 2 years ago

I'm currently installing nvidia docker on my machine, where the agent resides. I was also getting an error regarding gpu not being available in docker since the agent was running on docker mode. I'll share update in a bit. Trying to re run the whole set up

  
  
Posted 2 years ago

I'll take a look thank you

  
  
Posted 2 years ago

I want to serve using Nvidia Triton for now.

  
  
Posted 2 years ago