Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hello, Friends! I'Ve Got A Problem. I Am Trying To Restore Clearml Server From Backup. I Did What Docs Tell: Archived "Config" And "Data" Folders, Moved Them To New System. I Copied Docker Compose File And Set Correct Paths. When I Try To Run This Apiserv

Hello, friends!
I've got a problem. I am trying to restore ClearML server from backup. I did what docs tell: archived "config" and "data" folders, moved them to new system. I copied docker compose file and set correct paths. When I try to run this apiserver is restarting with "Node None has failed putting on 1 second timeout.", next there's a python traceback to error: "ApiError 405 Incorrect HTTP method for uri [/indextemplate/events*] and method [GET], allowed: [POST]". Could you please help me figure out how to troubleshoot this? I am happy to share any details needed.

  
  
Posted 4 months ago
Votes Newest

Answers 9


@<1526734383564722176:profile|BoredBat47> , that could indeed be an issue. If the server is still running things could be written in the databases, creating conflicts

  
  
Posted 3 months ago

@<1523701070390366208:profile|CostlyOstrich36>

  
  
Posted 4 months ago

All log entries have "level": "INFO"

  
  
Posted 4 months ago

What are the Elasticsearch, Mongo and apiserver versions in the docker compose are? Backup will only work in this scenario when they are exactly the same between 2 systems.

  
  
Posted 4 months ago

Can a problem be that backups are made while ClearML was running, not stopped, like docs suggest? @<1523701070390366208:profile|CostlyOstrich36>

  
  
Posted 3 months ago

@<1523701070390366208:profile|CostlyOstrich36> I understand but the description of the error seems to indicate not about database conflicts but about connectivity to elastic by apiserver. I couldn't find info about this on the internet. I think I ruled out incosistent image versions. Are there any more suggestions? Thanks.

  
  
Posted 3 months ago

I don't think so. Just some info about cluster state in there

  
  
Posted 4 months ago

Versions in compose are:
image: allegroai/clearml:1
image: elasticsearch:7.6.2
image: mongo:4.4.9

I am not quite sure that backups were made on those versions. Is there a way to see service versions from backup?

  
  
Posted 4 months ago

Hi @<1526734383564722176:profile|BoredBat47> , do you see any errors in the elastic container?

  
  
Posted 4 months ago
276 Views
9 Answers
4 months ago
3 months ago
Tags