Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi Everyone, I Noticed That Es Database Of My Local Server Instance Is Taking Up Huge Amount Of Ram (>32Gb Ram Usage For A ~80Gb Disk Space). There Is Enough Memory But I Also Run An Agent Instance On The Same Machine And Don'T Want To Dedicate That Much

Hi everyone,
I noticed that ES database of my local server instance is taking up huge amount of RAM (>32GB RAM usage for a ~80GB disk space). There is enough memory but I also run an agent instance on the same machine and don't want to dedicate that much to the server itself.
I see that the following was removed from the docker compose file a few months ago:
ES_JAVA_OPTS: -Xms2g -Xmx2g -Dlog4j2.formatMsgNoLookups=true
which AFAIK limited the available memory for the jvm. Would re-adding this solve my issue or is there a particular reason it was removed?
Thanks!

  
  
Posted 2 days ago
pic
More
ShaggySwan64
0 × 1
Report
Votes Newest

Answers 3

Hi @<1547028074090991616:profile|ShaggySwan64> , You can try this. However, Elastic takes space according to the amount of metrics you're saving. Clearing some older experiments would free up space. What do you think?

  
  
Posted 2 days ago
pic
More
CostlyOstrich36
0
Report

I don't mind the disk space but I am worried about the RAM usage which I think increased significantly with version upgrades more than added experiments. I will try both solutions when I get the chance and get back to you.

  
  
Posted 2 days ago
pic
More
ShaggySwan64
0 × 1
Report

Hi @<1547028074090991616:profile|ShaggySwan64> , by default ES allocates up to 50% of total RAM. If you think that this is an overkill for your case then you can limit it with ES_JAVA_OPTS parameters. I think that the 2GB limit that we had their earlier is too restrictive and may affect the ES performance and stability. So try putting there the number that depends on your needs and available memory but I would not go with less than 4Gb

  
  
Posted 2 days ago
pic
More
ResponsiveKoala38
0
Report
Write your answer
33 Views
3 Answers
2 days ago
one day ago
Tags
mlops