Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I Faced The Problem With Clearml-Serving. I'Ve Deployed Onnx Model From Higgingface In Clearml-Serving, But

Hi everyone!

I faced the problem with ClearML-serving. I've deployed onnx model from higgingface in clearml-serving, but "Error processing request: Error: Failed loading pre process code for '<>': No module named 'transformers'" appears when trying to send a request like in example.

Preprocessing file just like in example.

The transformers package has been installed with CLEARML_EXTRA_PYTHON_PACKAGES variable in serving service deployment file.

Anyone got any ideas?

Thanks in advance

  
  
Posted 11 months ago
Votes Newest

Answers 4


@<1523701118159294464:profile|ExasperatedCrab78> Thank you! It have solved the problem!

  
  
Posted 11 months ago

Hey! Sorry, didn't fully read your question and missed that you already did it. It should not be done inside the clearm-serving-triton service but instead inside the clearml-serving-inference service. This is where the preprocessing script is ran and it seems to be where the error is coming from.

  
  
Posted 11 months ago

@<1523701118159294464:profile|ExasperatedCrab78>
We use variables from .env file inside the clearm-serving-triton image, because we use helm chart to clearml-serving spinning. And still face the error

  
  
Posted 11 months ago

Hi! You should add extra packages in your docker-compse through your env file, they'll get installed when building the serving container. In this case you're missing the transformers package.

You'll also get the same explanation here .

  
  
Posted 11 months ago
607 Views
4 Answers
11 months ago
11 months ago
Tags