Hi @<1582542029752111104:profile|GorgeousWoodpecker69> , did you spin up the serving containers using docker-compose?
Answered
I Tried To Create A Model-Serving Endpoint With Clearml-Serving, But In The Ui It Is Shown As "Draft", And The Endpoint Is Not Available. How Can I Start The Service?
I tried to create a model-serving endpoint with clearml-serving, but in the UI it is shown as "Draft", and the endpoint is not available. How can I start the service?
clearml-serving --id xxx model add --engine triton --endpoint "model_api" --model-id xxx --input-size "[-1, -1]" "[-1, -1]" "[-1, -1]" --input-type int32 int32 int32 --input-name "input_ids" "token_type_ids" "attention_mask" --output-size "[-1, 2]" --output-type float32 --output-name "output" --aux-config platform=tensorrt_plan default_model_filename=pytorch_model.bin
826 Views
1
Answer
one year ago
one year ago
Tags