I'd been following the clearml serving example on its Github repo here. It basically deploys a keras mnist model. The tutorial however ends once the model is deployed however and I've tried going through resources on how to do inference but have had trouble understanding them. Is there a simple way to send inference requests to the server? Or do I just read through the Nvidia Triton docs on grpc etc
This is the simplest I could get for the inference request. The model and input and output names are the ones that the server wanted.
For anyone who's struggling with this. This is how I solved it. I'd personally not worked with GRPC so I instead looked at the HTTP docs and that one was much simpler to use.
Thanks VexedCat68 !
This is a great example, maybe PR it to the cleamrl-servvng repo ? wdyt?
