AgitatedDove14 SweetBadger76 i hope you can help with one more question
For the test I logged my new model to clearml-server file host and take models for clearml-serving from there. And it works with clearml-serving model add, but for clearml-serving model auto-update i do not exactly understand what happens. I see my auto-update model in models list in serving, but in output logs triton print that poll failed.
command for add model (which works)clearml-serving --id 5e4851e9ec3f4f148e6bd21e68fe22c1 model add --engine triton --endpoint "test_model_pytorch_auto" --preprocess "examples/pytorch/preprocess.py" --name "test torch auto update v2" --project "serving test" --input-size 1 28 28 --input-name "INPUT__0" --input-type float32 --output-size -1 10 --output-name "OUTPUT__0" --output-type float32
command for model auto-update (which has some problems)clearml-serving --id 5e4851e9ec3f4f148e6bd21e68fe22c1 model auto-update --engine triton --endpoint "test_model_pytorch_auto_v2" --preprocess "examples/pytorch/preprocess.py" --name "test torch auto update v2" --project "serving test" --input-size 1 28 28 --input-name "INPUT__0" --input-type float32 --output-size -1 10 --output-name "OUTPUT__0" --output_type float32
and in this command ( clearml-serving --id 5e4851e9ec3f4f148e6bd21e68fe22c1 model list
) output i see model which i added with model add
in endpoints
and can make requests and get responces
but the model which i added with model auto-update
i see in Model Monitorings
and can’t make requests on it