Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I Have A Question About

Hi everyone!

I have a question about clearml-serving . Are there any examples how to deploy models via clearml-serving ... model add ... with Python code?
If I use example commands with os.system - I have some issues with generating triton file config.pbtxt and using "\" in it

  
  
Posted 10 months ago
Votes Newest

Answers 5


@<1523701070390366208:profile|CostlyOstrich36>

I spin endpoint with:
!clearml-serving --id "<>" model add --engine triton --endpoint 'modelname' --model-id '<>' --preprocess 'preprocess.py' --input-size '[-1, -1]' '[-1, -1]' '[-1, -1]' --input-name 'input_ids' 'token_type_ids' 'attention_mask' --input-type int64 int64 int64 --output-size '[-1, -1]' --output-name 'logits' --output-type float32 --aux-config name=\"modelname\" platform=\"onnxruntime_onnx\" default_model_filename=\"model.bin\"

Also I tried with os.system:
os.system("clearml-serving --id "<>" model add --engine triton --endpoint 'modelname' --model-id '<>' --preprocess 'preprocess.py' --input-size '[-1, -1]' '[-1, -1]' '[-1, -1]' --input-name 'input_ids' 'token_type_ids' 'attention_mask' --input-type int64 int64 int64 --output-size '[-1, -1]' --output-name 'logits' --output-type float32 --aux-config name=\"modelname\" platform=\"onnxruntime_onnx\" default_model_filename=\"model.bin\"")

  
  
Posted 10 months ago

Hi @<1523701070390366208:profile|CostlyOstrich36> Yes

Or run clearml-serving python code without CLI wrapper

  
  
Posted 10 months ago

Hi @<1569496075083976704:profile|SweetShells3> , do you mean to run the CLI command via python code?

  
  
Posted 10 months ago

How are you currently trying to wrap it up in python?

  
  
Posted 10 months ago

Expected behavior - pic 1
Actual behavior - pic 2
image
image

  
  
Posted 10 months ago
509 Views
5 Answers
10 months ago
10 months ago
Tags
Similar posts