Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Answered
Hi! I Have Noticed That Clearml-Elastic Container Consumes 32.82Gib Memory. This Seems

Hi!
I have noticed that clearml-elastic container consumes 32.82GiB Memory. This seems very high (we have a total of 91GiB available -> elastic uses 1/3).
Is this normal? If not, what could be the issue?

Best,
Valentin
image

  
  
Posted one month ago
Votes Newest

Answers 9


Sorry I missed your message: no I don't know what happen when ES reach its RAM limit. We do self-host in Azure and use ES SaaS. Our cloud engineer manage that part.
My only experience was when I tried to spin up my local server, from docker compose, to test something and it took my PC down because ES eat all my RAM !!

  
  
Posted 29 days ago

Thank you for getting back!
I have reduced it to a max of 2GB for the container and 1GB for the java heap inside the container. Up to now I haven’t experienced any issues 👍

  
  
Posted 29 days ago

@<1576381444509405184:profile|ManiacalLizard2> Do you have an observation/experience as to what happens when ES hits the limit?

  
  
Posted 29 days ago

I think ES use a greedy strategy where it allocate first then use it from there ...

  
  
Posted one month ago

@<1576381444509405184:profile|ManiacalLizard2> what happens when ES hits the limit? Does it go OOM, or does the scalars loading just take a long time in the web-ui? And what about tasks putting scalars in the index?

  
  
Posted one month ago

It seems elastic has allocated a heap of 32GiB, but uses only 4GiB. Where/why have 32GiB been allocated?

  
  
Posted one month ago

And how much memory does ElasticSearch realistically need?

  
  
Posted 29 days ago

Can you share the elastic part of your docker container? Are you using any overrides?

  
  
Posted one month ago

Last time I tried docker compose, elastic take a lot of RAM !!
You need to limit its RAM usage with mem_limit :

[...]
  elasticsearch:
    networks:
      - backend
    container_name: clearml-elastic
    mem_limit: 2g
    environment:
      bootstrap.memory_lock: "true"
      cluster.name: clearml
[...]
  
  
Posted one month ago
179 Views
9 Answers
one month ago
28 days ago
Tags