Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Is There A Way To Generate Usage Stats And Reports For Queues? For Example, How Often Is A Queue Used, How Much Cpu Does

Is there a way to generate usage stats and reports for queues? For example, how often is a queue used, how much CPU does the queue consume when it's used, etc?
If not, is it available for the workers? The graph generated in the WebUI is somewhat lacking

  
  
Posted 2 years ago
Votes Newest

Answers 7


Hi UnevenDolphin73 , can you please elaborate on what do you mean by what CPU does the queue consume?

You can pull all machine usage statistics using the API. Is there something specific you're looking for?

  
  
Posted 2 years ago

We're wondering how many on-premise machines we'd like to deprecate. For that, we want to see how often our "on premise" queue is used (how often a task is submitted and run), for how long, how many resources it consumes (on average), etc.

  
  
Posted 2 years ago

I think this might be what you're looking for:
https://clear.ml/docs/latest/docs/references/api/workers
https://clear.ml/docs/latest/docs/references/api/queues
You can access all reports through the REST API

  
  
Posted 2 years ago

We're wondering how many on-premise machines we'd like to deprecate.

I think you can see that in the queues tab, no?

  
  
Posted 2 years ago

AgitatedDove14 Unfortunately not, the queues tab shows only the number of tasks, but not resources used in the queue . I can toggle between the different workers but then I don't get the full image.

  
  
Posted 2 years ago

CostlyOstrich36 That looks promising, but I don't see any documentation on the returned schema (i.e. workers.worker_stats is not specified anywhere?)

  
  
Posted 2 years ago

Unfortunately not, the queues tab shows only the number of tasks, but not resources used

in the queue

Oh, yes, that makes sense to add, I like that 🙂
(the main question is what data is there in the backend DBs, let me know what I can get)

  
  
Posted 2 years ago
906 Views
7 Answers
2 years ago
one year ago
Tags