Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
GloriousKoala29
Moderator
3 Questions, 4 Answers
  Active since 19 July 2024
  Last activity 4 months ago

Reputation

0

Badges 1

4 × Eureka!
0 Votes
2 Answers
382 Views
0 Votes 2 Answers 382 Views
Hi community :) I'm new to ClearML and seeking advice on best practices for managing datasets. I have two types of datasets: (1) PDFs (2) Tabular data stored...
4 months ago
0 Votes
2 Answers
227 Views
0 Votes 2 Answers 227 Views
A Question regarding optimizing API usage for production monitoring Hi, I'm currently using ClearML for monitoring a production environment where I report me...
4 months ago
0 Votes
5 Answers
464 Views
0 Votes 5 Answers 464 Views
5 months ago
0 Hey, My Name Is Ido, And I Am A New Clearml User. My Goal Is To Monitor The Accuracy Of My Llm Outputs In Production. I Understand That I Can Log Each Iteration With A Binary Output (0 For Incorrect And 1 For Correct), But This Approach Makes The Visual G

@<1523701205467926528:profile|AgitatedDove14> Thanks! The only thing is that I prefer serving my models in-house and only performing the monitoring via ClearML. By the way, I saw there is a project dashboard app which might support the visualization I am looking for. Is it suitable for such use case?

5 months ago
0 Hey, My Name Is Ido, And I Am A New Clearml User. My Goal Is To Monitor The Accuracy Of My Llm Outputs In Production. I Understand That I Can Log Each Iteration With A Binary Output (0 For Incorrect And 1 For Correct), But This Approach Makes The Visual G

Hi @<1523701205467926528:profile|AgitatedDove14> ,
I guess I can log the input-output pairs and report the average accuracy as a scalar. However, I'm not sure if this is the right way to monitor my data. Obviously, using iterations makes sense when training a model and tracking the loss, but when we are in production, I'm not sure if this dashboard is meant for that purpose.

5 months ago