Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I Faced The Problem With Clearml-Serving. I'Ve Deployed Onnx Model From Higgingface In Clearml-Serving, But

Hi everyone!

I faced the problem with ClearML-serving. I've deployed onnx model from higgingface in clearml-serving, but "Error processing request: Error: Failed loading pre process code for '<>': No module named 'transformers'" appears when trying to send a request like in example.

Preprocessing file just like in example.

The transformers package has been installed with CLEARML_EXTRA_PYTHON_PACKAGES variable in serving service deployment file.

Anyone got any ideas?

Thanks in advance

  
  
Posted 11 months ago
Votes Newest

Answers 4


Hi! You should add extra packages in your docker-compse through your env file, they'll get installed when building the serving container. In this case you're missing the transformers package.

You'll also get the same explanation here .

  
  
Posted 11 months ago

Hey! Sorry, didn't fully read your question and missed that you already did it. It should not be done inside the clearm-serving-triton service but instead inside the clearml-serving-inference service. This is where the preprocessing script is ran and it seems to be where the error is coming from.

  
  
Posted 11 months ago

@<1523701118159294464:profile|ExasperatedCrab78>
We use variables from .env file inside the clearm-serving-triton image, because we use helm chart to clearml-serving spinning. And still face the error

  
  
Posted 11 months ago

@<1523701118159294464:profile|ExasperatedCrab78> Thank you! It have solved the problem!

  
  
Posted 11 months ago
599 Views
4 Answers
11 months ago
11 months ago
Tags