Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Profile picture
GloriousKoala29
Moderator
3 Questions, 4 Answers
  Active since 19 July 2024
  Last activity 2 months ago

Reputation

0

Badges 1

4 × Eureka!
0 Votes
2 Answers
161 Views
0 Votes 2 Answers 161 Views
A Question Regarding Optimizing Api Usage For Production Monitoring
A Question regarding optimizing API usage for production monitoring Hi, I'm currently using ClearML for monitoring a production environment where I report me...
2 months ago
0 Votes
2 Answers
271 Views
0 Votes 2 Answers 271 Views
Hi Community :) I'M New To Clearml And Seeking Advice On Best Practices For Managing Datasets. I Have Two Types Of Datasets: (1) Pdfs (2) Tabular Data Stored In Excel.
Hi community :) I'm new to ClearML and seeking advice on best practices for managing datasets. I have two types of datasets: (1) PDFs (2) Tabular data stored...
3 months ago
0 Votes
5 Answers
369 Views
0 Votes 5 Answers 369 Views
Hey, My Name Is Ido, And I Am A New Clearml User. My Goal Is To Monitor The Accuracy Of My Llm Outputs In Production. I Understand That I Can Log Each Iteration With A Binary Output (0 For Incorrect And 1 For Correct), But This Approach Makes The Visual G
Hey, my name is Ido, and I am a new ClearML user. My goal is to monitor the accuracy of my LLM outputs in production. I understand that I can log each iterat...
3 months ago
0 A Question Regarding Optimizing Api Usage For Production Monitoring

I see, thanks Jake!

2 months ago
0 Hi Community :) I'M New To Clearml And Seeking Advice On Best Practices For Managing Datasets. I Have Two Types Of Datasets: (1) Pdfs (2) Tabular Data Stored In Excel.

I see, thanks for that!

3 months ago
0 Hey, My Name Is Ido, And I Am A New Clearml User. My Goal Is To Monitor The Accuracy Of My Llm Outputs In Production. I Understand That I Can Log Each Iteration With A Binary Output (0 For Incorrect And 1 For Correct), But This Approach Makes The Visual G

Hi @<1523701205467926528:profile|AgitatedDove14> ,
I guess I can log the input-output pairs and report the average accuracy as a scalar. However, I'm not sure if this is the right way to monitor my data. Obviously, using iterations makes sense when training a model and tracking the loss, but when we are in production, I'm not sure if this dashboard is meant for that purpose.

3 months ago
0 Hey, My Name Is Ido, And I Am A New Clearml User. My Goal Is To Monitor The Accuracy Of My Llm Outputs In Production. I Understand That I Can Log Each Iteration With A Binary Output (0 For Incorrect And 1 For Correct), But This Approach Makes The Visual G

@<1523701205467926528:profile|AgitatedDove14> Thanks! The only thing is that I prefer serving my models in-house and only performing the monitoring via ClearML. By the way, I saw there is a project dashboard app which might support the visualization I am looking for. Is it suitable for such use case?

3 months ago