Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! I Had A Self-Hosted Clearml And I Want To Visualize Aggregated Metrics (Mean, Norimalized Mean, Dispersion Etc) To Compare Clearml Projects. How Can I Do That? As I Know, Clearml Web Ui Can'T Do It, It Can Compare Only Few Separate Experiments In One

Hi! I had a self-hosted ClearML and I want to visualize aggregated metrics (mean, norimalized mean, dispersion etc) to compare ClearML projects. How can I do that? As I know, ClearML Web UI can't do it, it can compare only few separate experiments in one project. So simple workaround is a dashboard in Dash app + ClearML API. But are there any better solutions? Kibana or Grafana? Direct connection to MongoDB?
Thank you!

  
  
Posted 7 months ago
pic
More
EnviousPanda91
0 × 1
Report
Votes Newest

Answers 5

I want aggregate only final metrics from the model. For example, "Metric HO" (holdout) here:
image

  
  
Posted 7 months ago
pic
More
EnviousPanda91
0 × 1
Report

In that case I suggest you write some basic code that will aggregate and compute those values for you for comparison

  
  
Posted 7 months ago
pic
More
CostlyOstrich36
0
Report

Hi @<1523701760676335616:profile|EnviousPanda91> , when you are in comparison mode you can add any task, unrelated to which project it is in. Also the scalar final values. Or am I missing something?

  
  
Posted 7 months ago
pic
More
CostlyOstrich36
0
Report

this is the case of developing AutoML: when I have a lot of datasets and the model should be nice at all datasets in average. So projects here are different versions of AutoML and I need to compare them

  
  
Posted 7 months ago
pic
More
EnviousPanda91
0 × 1
Report

@<1523701070390366208:profile|CostlyOstrich36> I need to compare aggregated values: I want to compare mean metric value of N experiments from project 1 vs mean metric value of N experiments from project 2

  
  
Posted 7 months ago
pic
More
EnviousPanda91
0 × 1
Report
Write your answer
638 Views
5 Answers
7 months ago
7 months ago
Tags
clearml