Unanswered
[Clearml Serving]
Hi Everyone!
I Am Trying To Automatically Generate An Online Endpoint For Inference When Manually Adding Tag
I notice that, in my Serving Service situated in the DevOps project, the "endpoints" section doesn't seem to get updated when I tag a new model with "released".
It takes it a few minutes (I think 5 min is the default) to update.
Notice that you need to add the model with
model auto-update --engine triton --endpoint "test_model_pytorch_auto" ...
Not with model add (if for some reason that does not work please let me know)
No need to pass the model version i.e. 1
you can just address the "main" endpoint and get the latest version:
so curl -X POST "
[None](http://127.0.0.1:8080/serve/test_model_pytorch)
" will be the latest model and /1 /2 will be specific versions (i.e. previous versions)
Regarding the DevOps project, when creating the serving session add --project to change it
clearml-serving create --project <serving project>
See None
119 Views
0
Answers
one year ago
one year ago