Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi, I Am Having Trouble With Comparing Plotly Plots From Different Experiments. The Plots, When You Look At Them Within One Experiment Look Fine (Attaching Screenshot), However Once You Try To Compare Plots From Two Experiments There Are Few Problems:

Hi,
I am having trouble with comparing plotly plots from different experiments. The plots, when you look at them within one experiment look fine (attaching screenshot), however once you try to compare plots from two experiments there are few problems:

  • the variable names are changing and not diplaying anymore the "y_pred", "y_test" labels from individual plots - how can I keep the original names?
  • when I try to change color it changes two line at the same time (see attached gif) - how can I change color of just one line?
  • when I try to hide one line it hides two lines at the same time (see attached gif) - how can I hide just one line?
    image
    image
  
  
Posted one year ago
Votes Newest

Answers 8


@<1566596960691949568:profile|UpsetWalrus59> - please note that if you report the plots as two separate series of the same metric - it should work better

  
  
Posted one year ago

@<1566596960691949568:profile|UpsetWalrus59> - if you could also paste the payload and response of the call to events.get_multi_task_plots - from the network tab of the browser's dev-tools (F12), this might also help understand

  
  
Posted one year ago

Hi @<1566596960691949568:profile|UpsetWalrus59>
Could it be the two experiments have the exact name ?
(I sounds like a bug in the UI, but I'm trying to make sure, and also understand how to reproduce)
What's your clearml-server version ?

  
  
Posted one year ago

Thank you @<1566596960691949568:profile|UpsetWalrus59> for sharing these steps , we were able to reproduce on our end and working on a fix

  
  
Posted one year ago

Request payload:

{"tasks":["425335514d444646b1077cb8b738ccf7","3c0db63779e940cc80895af728aac5ab"],"model_events":false,"no_scroll":true,"iters":1}
  
  
Posted one year ago

Great, thanks!

  
  
Posted one year ago

Response:

  
  
Posted one year ago

I came up with this minimal example - it is a bit different but the behavior is also not as expected I think:

import numpy as np
import plotly.express as px
from clearml import Task

task = Task.init(project_name='MyProject', task_name='task1', 
                 task_type=Task.TaskTypes.training)
logger = task.get_logger()
y_pred = np.random.rand(100)
y_test = np.random.rand(100)
fig = px.line({'y_pred': y_pred, 'y_test': y_test})
logger.report_plotly(title=f'Forecast', series=f'Forecast', iteration=0, figure=fig)

I executed this code twice with just changing the task_name to 'task2'.
Server version is WebApp: 3.17.1-1039

  
  
Posted one year ago