Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Heya, I'M Getting This Error In Clearml-Serving-Triton Using The Helm Chart:

Heya, I'm getting this error in clearml-serving-triton using the helm chart:

CLEARML_SERVING_TASK_ID=8962...
CLEARML_TRITON_POLL_FREQ=1.0
CLEARML_TRITON_METRIC_FREQ=1.0
CLEARML_TRITON_HELPER_ARGS=
CLEARML_EXTRA_PYTHON_PACKAGES=
clearml-serving - Nvidia Triton Engine Controller
Traceback (most recent call last):
  File "clearml_serving/engines/triton/triton_helper.py", line 540, in <module>
    main()
  File "clearml_serving/engines/triton/triton_helper.py", line 510, in main
    serving_task = ModelRequestProcessor._get_control_plane_task(task_id=args.inference_task_id)
  File "/root/clearml/clearml_serving/serving/model_request_processor.py", line 1257, in _get_control_plane_task
    raise ValueError("Could not find any valid Control Tasks")
ValueError: Could not find any valid Control Tasks
  
  
Posted one year ago
pic
More
YummyElephant76
0 × 1
Report
Votes Newest

Answers 6

From any computer that has ClearML serving installed. It is simply used to submit configurations, not actually run anything. Please refer to the step by step setup here for more info 🙂

  
  
Posted one year ago
pic
More
ExasperatedCrab78
0 × 1
Report

I'm using the helm chart, is that not part of it?

  
  
Posted one year ago
pic
More
YummyElephant76
0 × 1
Report

Nope! The helm chart sets up all the infrastructure to run everything. What exactly to run is decided using the clearml-serving CLI. Using it, you can swap out models, setup A/B testing of different versions, do canary rollouts etc. But the HELM stack is there only to run what you defined using the CLI

  
  
Posted one year ago
pic
More
ExasperatedCrab78
0 × 1
Report

thanks!

  
  
Posted one year ago
pic
More
YummyElephant76
0 × 1
Report

where do i run clearml-serving then?

  
  
Posted one year ago
pic
More
YummyElephant76
0 × 1
Report

Hi! Have you run clearml-serving create ... first? Usually you'd make what's called a "control plane task" first, that will hold all your configuration. Step 4 in the initial setup instructions is where you'll find it!

  
  
Posted one year ago
pic
More
ExasperatedCrab78
0 × 1
Report
Write your answer
1K Views
6 Answers
one year ago
one year ago
Tags
clearml