Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone! I Have A Question About

Hi everyone!

I have a question about clearml-serving . Are there any examples how to deploy models via clearml-serving ... model add ... with Python code?
If I use example commands with os.system - I have some issues with generating triton file config.pbtxt and using "\" in it

  
  
Posted 10 months ago
Votes Newest

Answers 5


Hi @<1523701070390366208:profile|CostlyOstrich36> Yes

Or run clearml-serving python code without CLI wrapper

  
  
Posted 10 months ago

How are you currently trying to wrap it up in python?

  
  
Posted 10 months ago

@<1523701070390366208:profile|CostlyOstrich36>

I spin endpoint with:
!clearml-serving --id "<>" model add --engine triton --endpoint 'modelname' --model-id '<>' --preprocess 'preprocess.py' --input-size '[-1, -1]' '[-1, -1]' '[-1, -1]' --input-name 'input_ids' 'token_type_ids' 'attention_mask' --input-type int64 int64 int64 --output-size '[-1, -1]' --output-name 'logits' --output-type float32 --aux-config name=\"modelname\" platform=\"onnxruntime_onnx\" default_model_filename=\"model.bin\"

Also I tried with os.system:
os.system("clearml-serving --id "<>" model add --engine triton --endpoint 'modelname' --model-id '<>' --preprocess 'preprocess.py' --input-size '[-1, -1]' '[-1, -1]' '[-1, -1]' --input-name 'input_ids' 'token_type_ids' 'attention_mask' --input-type int64 int64 int64 --output-size '[-1, -1]' --output-name 'logits' --output-type float32 --aux-config name=\"modelname\" platform=\"onnxruntime_onnx\" default_model_filename=\"model.bin\"")

  
  
Posted 10 months ago

Expected behavior - pic 1
Actual behavior - pic 2
image
image

  
  
Posted 10 months ago

Hi @<1569496075083976704:profile|SweetShells3> , do you mean to run the CLI command via python code?

  
  
Posted 10 months ago
514 Views
5 Answers
10 months ago
10 months ago
Tags
Similar posts