Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! A Question About Self Hosting In K8S. Wanted To Know What Is The Best Practice For Backing Up And Restoring The File Server (Experiments Data And Etc.) Is There A Dedicated Command? Maybe A Volume Snapshot At The K8S Level? I’M Looking For A Procedure

Hi!
A question about self hosting in k8s.
Wanted to know what is the best practice for backing up and restoring the file server (experiments data and etc.)
Is there a dedicated command? maybe a volume snapshot at the k8s level? I’m looking for a procedure that can completely restore state after a cluster teardown.

Thanks!

  
  
Posted 11 months ago
Votes Newest

Answers 13


Hi @<1528908687685455872:profile|MassiveBat21> , the fileserver can be backed up using a volume snapshot. As for the other databases (ES, Mongo), you should use the appropriate backup method recommended in their documentation

  
  
Posted 11 months ago

fileserver contains uploaded files (like debug samples, perhaps models and artifacts if you're not using S3 or the like), ES contains metrics and events and Mongo has all the metadata

  
  
Posted 11 months ago

So projects/experiments -> mongo

  
  
Posted 11 months ago

will a partial backup of just say mongo work? Or are all the dbs expected to restore together?

  
  
Posted 11 months ago

all are related

  
  
Posted 11 months ago

Hi @<1523701087100473344:profile|SuccessfulKoala55> , just as an afterthought:
Since elastic and mongo data are stored in volumes too, couldn’t a restore simply mean restoring a snapshot of all those 3 volumes as a whole?

  
  
Posted 11 months ago

I would assume so, but you'll have to shut down the entire system to do that

  
  
Posted 11 months ago

(to back up as well, not just to restore)

  
  
Posted 11 months ago

as to not create a snapshot of an unstable state?

  
  
Posted 11 months ago

Alright, I see.
Thanks again

  
  
Posted 11 months ago

exactly

  
  
Posted 11 months ago

OK, got it. Thank you @<1523701087100473344:profile|SuccessfulKoala55> !

  
  
Posted 11 months ago

Thanks for the response. So I’ll go with an automated snapshot.
What should I expect to be stored in ES and mongo, and what’s in the file server?

  
  
Posted 11 months ago
498 Views
13 Answers
11 months ago
11 months ago
Tags