Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hi All, I Am Trying To Add A Model To My Recently Setup K8S Self-Hosted Clearml-Serving. The Command Looks Like This And Worked Whith My Previous Docker Setup:

Hi all, I am trying to add a model to my recently setup k8s self-hosted clearml-serving. The command looks like this and worked whith my previous docker setup:
clearml-serving --id fec7d23cc2b848b48d15041ce965ed81 model add --engine triton --endpoint "advanced_basic_classifier" --preprocess "src/preprocessing/preprocess.py" --model-id 837276fc8d8a443fb91f48d722300b0a --input-size 1 64 --input-name "INPUT__0" --input-type float32 --output-size 1 11 --output-name "OUTPUT__0" --output-type float32
But with the k8s setup I get this error on the triton node

E0405 14:50:27.960808 35 model_repository_manager.cc:996] Poll failed for model directory 'advanced_basic_classifier': Invalid model name: Could not determine backend for model 'advanced_basic_classifier' with no backend in model configuration. Expected model name of the form 'model.<backend_name>'.

Afterwards I changed the endpoint to advanced_basic_classifier.pytorch according to the error message and got a new error

E0405 14:55:27.962135 35 model_repository_manager.cc:996] Poll failed for model directory 'advanced_basic_classifier.pytorch': unexpected 'platform' and 'backend' pair, got:, pytorch

So I tried to specify the platform with the aux-config flag, but the error message still did not change. Even when I pass a whole config.pbtxt file with the aux-config flag no specification of the platform is detected. Does anybody know how to solve this issue?

Posted one month ago
Votes Newest


0 Answers
one month ago
one month ago