Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hey There I'M Currently Trying To Set Up Clearml Serving While Using Triton As My Engine. I'M Currently Experincing 405 Errors When Calling My Endpoint Or Triton Just Crashes. Can Anyone Help Out?

Hey there I'm currently trying to set up clearML serving while using Triton as my Engine. I'm currently experincing 405 errors when calling my endpoint or triton just crashes. Can anyone help out?

  
  
Posted 20 days ago
Votes Newest

Answers 7


Hi @<1739455989154844672:profile|SmarmyHamster62> , can you add some logs from the triton container while you try calling your endpoint?

  
  
Posted 20 days ago

@<1739455989154844672:profile|SmarmyHamster62> , I suggest updating your versions. The server is a bit old

  
  
Posted 20 days ago

alright Thank you

  
  
Posted 20 days ago

Also a newer version to the serving as well

  
  
Posted 20 days ago

thanks for looking into my problem

  
  
Posted 20 days ago

we are currently using ClearML Server 1.13.0 and ClearML Serving 1.3.0.

  
  
Posted 20 days ago

Since recieving the 405 the triton container just prints the following information Info: syncing models from main serving service
reporting metrics: relative time 13998 sec I already restarted clearml completely. This Morning the triton container just crahsed when serving a different model There I've got the following errors:

Update model v1 in /models/tritontest/1
copy model into /models/tritontest/1/model.bin
Starting server: ['tritonserver', '--model-control-mode=poll', '--model-repository=/models', '--repository-poll-secs=60.0', '--metrics-port=8002', '--allow-metrics=true', '--allow-gpu-metrics=true']
1724678179082 mips-data-analytics-platform-clearml-serving-triton-5d8874kpsq2 error Traceback (most recent call last):
  File "clearml_serving/engines/triton/triton_helper.py", line 540, in <module>
    main()
  File "clearml_serving/engines/triton/triton_helper.py", line 532, in main
    helper.maintenance_daemon(
  File "clearml_serving/engines/triton/triton_helper.py", line 274, in maintenance_daemon
    raise ValueError("triton-server process ended with error code {}".format(error_code))
ValueError: triton-server process ended with error code 1
  
  
Posted 20 days ago
73 Views
7 Answers
20 days ago
19 days ago
Tags