Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi All. In Self Hosted Clearml Suddenly Scalars Stopped To Be Shown In Scalars Tab. Any Ideas?

Hi all. In self hosted CLEARML suddenly scalars stopped to be shown in SCALARS tab. Any ideas?

  
  
Posted 11 months ago
Votes Newest

Answers 12


Hi @<1523701553372860416:profile|DrabOwl94> , can you check if there are some errors in the Elastic container?

  
  
Posted 11 months ago

(wrong tab sorry :P)

  
  
Posted 11 months ago

{"type": "server", "timestamp": "2023-06-21T08:26:03,816Z", "level": "ERROR", "component": "o.e.b.ElasticsearchUncaughtExceptionHandler", "cluster.name": "${sys:es.logs.cluster_name}", "node.name": "clearml", "message": "uncaught exception in thread [process reaper (pid 218)]", "cluster.uuid": "9l7JSn6ES0upH0UZK2C8Tw", "node.id": "x3JpeJiKSWSNsz8s7Y0Kuw" ,
uncaught exception in thread [process reaper (pid 218)]
java.security.AccessControlException: access denied ("java.lang.RuntimePermission" "modifyThread")
        at java.base/java.security.AccessControlContext.checkPermission(AccessControlContext.java:485)
        at java.base/java.security.AccessController.checkPermission(AccessController.java:1068)
        at java.base/java.lang.SecurityManager.checkPermission(SecurityManager.java:411)
        at org.elasticsearch.secure_sm.SecureSM.checkThreadAccess(SecureSM.java:160)
        at org.elasticsearch.secure_sm.SecureSM.checkAccess(SecureSM.java:120)
        at java.base/java.lang.Thread.checkAccess(Thread.java:2360)
        at java.base/java.lang.Thread.setDaemon(Thread.java:2308)
        at java.base/java.lang.ProcessHandleImpl.lambda$static$0(ProcessHandleImpl.java:103)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.<init>(ThreadPoolExecutor.java:637)
        at java.base/java.util.concurrent.ThreadPoolExecutor.addWorker(ThreadPoolExecutor.java:928)
        at java.base/java.util.concurrent.ThreadPoolExecutor.processWorkerExit(ThreadPoolExecutor.java:1021)
        at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1158)
        at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
        at java.base/java.lang.Thread.run(Thread.java:1589)
        at java.base/jdk.internal.misc.InnocuousThread.run(InnocuousThread.java:186)
  
  
Posted 11 months ago

@<1523701553372860416:profile|DrabOwl94> , I would suggest restarting the elastic container. If that doesn't help, check the ES folder permissions - maybe something changed

  
  
Posted 11 months ago

can upgrading to 1.11.0 help?

  
  
Posted 11 months ago

restarted ES container. same. no scalars

  
  
Posted 11 months ago

Did you check permissions?

  
  
Posted 11 months ago

only GPU and machine

  
  
Posted 11 months ago

image

  
  
Posted 11 months ago

Having the latest versions is always a good practice

  
  
Posted 11 months ago

yes

  
  
Posted 11 months ago

Just make sure you make regular backups

  
  
Posted 11 months ago
583 Views
12 Answers
11 months ago
11 months ago
Tags