Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello Everyone. After Restart Self-Hosted Clearml Server The Data From Tabs Plots, Console And Scalars Are Gone Away For Every My Previous Experiment. But In Folders

Hello everyone. After restart self-hosted ClearML server the data from tabs PLOTS, CONSOLE and SCALARS are gone away for every my previous experiment. But in folders /opt/clearml/data/fileserver/ pictures of plots , for example , exist with proper task id. What does the problem can be?

  
  
Posted one year ago
Votes Newest

Answers 8


Hi @<1533982060639686656:profile|AdorableSeaurchin58>
Notice the scalars and console are stored on the elasticsearch DB, this is usually under
/opt/clearml/data/elastic_7

  
  
Posted one year ago

@<1533982060639686656:profile|AdorableSeaurchin58> this was just a restart? or an upgrade? If so, it's possible you have an issue with the ElasticSearch server, can you do docker ps and share the results?

  
  
Posted one year ago

@<1523701087100473344:profile|SuccessfulKoala55>
First time I try restart, later try to upgrade. Behavior the same in both cases.

  
  
Posted one year ago

@<1523701087100473344:profile|SuccessfulKoala55>
image

  
  
Posted one year ago

A small remark, before upgrading ClearML server with new docker-compose file I use ElasticSearch image directly from dockerhub , not from docker.elastic storage.

  
  
Posted one year ago

Can you get the log for the clearml-elastic container?

  
  
Posted one year ago

@<1523701087100473344:profile|SuccessfulKoala55>

  
  
Posted one year ago

@<1533982060639686656:profile|AdorableSeaurchin58> I see no problem in those logs. I can only assume perhaps an upgrade was performed and the new docker-compose.yml file uses a different data folder as the mount point for the ES data folder?

  
  
Posted one year ago
1K Views
8 Answers
one year ago
one year ago
Tags