Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, I'M Trying Clearml-Serving On Any Of The Example Models From The 'Clearml Examples' Project. After Running 'Clearml-Serving Triton ...' I Always Get The Following Error: Clearml-Serving Triton --Endpoint "Keras_Mnist" --Model-Project "Clearml Exa

Hello, I'm trying clearml-serving on any of the example models from the 'ClearML Examples' project. After running 'clearml-serving triton ...' I always get the following error:

clearml-serving triton --endpoint "keras_mnist" --model-project "ClearML Examples" --model-name "Tensorflow v2 mnist with summaries"
clearml-serving - CLI for launching ClearML serving engine
Nvidia Triton Engine ID: 2f6dc1d21bfc43af9521985b72af1b98 - Adding serving endpoint:
model-project: 'ClearML Examples', model-name: 'Tensorflow v2 mnist with summaries', model-tags: '', config-file: ''

Error: Requested Model project=ClearML Examples name=Tensorflow v2 mnist with summaries tags=None not found. 'config.pbtxt' could not be inferred. please provide specific config.pbtxt definition.

  
  
Posted 2 years ago
Votes Newest

Answers 5


Sorry ScaryLeopard77 I missed the reply,

the tutorial in the readme of clearml-serving repo doesn't mention it though. Where should I set it?

oh dear ... you are right (I think it was there in previous versions)
clearml-serving --helphttps://github.com/allegroai/clearml-serving/blob/ce6ec847b1e01c6f5bf35d638e6ceb8148db8a7a/clearml_serving/main.py#L142
This is the equivalent of what is created here in the example:
https://github.com/allegroai/clearml-serving/blob/ce6ec847b1e01c6f5bf35d638e6ceb8148db8a7a/examples/keras/keras_mnist.py#L51

  
  
Posted 2 years ago

Hi ScaryLeopard77
I think the error message you are getting is actually "passed" from Triton. Basically someone needs to tell it what the Model in/out look like (matrix size/type) this is essentially the content of the "config.pbtxt" , and this has to be set when spinning the model endpoint. does that make sense to you?

  
  
Posted 2 years ago

What version of ClearML-Serving are you using? Are you running on a self hosted server?

  
  
Posted 2 years ago

I'm connected to the managed server, I'm using version 0.3.3.

  
  
Posted 2 years ago

Hi AgitatedDove14 , the tutorial in the readme of clearml-serving repo doesn't mention it though. Where should I set it?

  
  
Posted 2 years ago
1K Views
5 Answers
2 years ago
one year ago
Tags