Examples: query, "exact match", wildcard*, wild?ard, wild*rd
Fuzzy search: cake~ (finds cakes, bake)
Term boost: "red velvet"^4, chocolate^2
Field grouping: tags:(+work -"fun-stuff")
Escaping: Escape characters +-&|!(){}[]^"~*?:\ with \, e.g. \+
Range search: properties.timestamp:[1587729413488 TO *] (inclusive), properties.title:{A TO Z}(excluding A and Z)
Combinations: chocolate AND vanilla, chocolate OR vanilla, (chocolate OR vanilla) NOT "vanilla pudding"
Field search: properties.title:"The Title" AND text
Hey Guys, A Question About Monthly Worker_Stats Indices Each Of Them Takes Up About 1Gb For Us. Do We Really Need To Keep All Of Them? Is There Any Way To Free Up The Space?

hey guys, a question about monthly worker_stats indices

each of them takes up about 1gb for us. do we really need to keep all of them? is there any way to free up the space?

Posted 3 years ago
Votes Newest

Answers 5

yeah, backups take much longer, and we had to increase our EC2 instance volume size twice because of these indices

got it, thanks, will try to delete older ones

Posted 3 years ago

Can you do selective backup and simply not backup these indices?

Posted 3 years ago

Hey DilapidatedDucks58 !
These indices are not mandatory, and basically provide historical information on worker statistics and performance that is displayed in the workers and queues page, and is also available for debugging and optimization purposes.

You can safely delete them (also periodically using a script, if you'd like). From what I see you're more concerned with their size on disk and no from the number of indices (1 each month)?

Posted 3 years ago

If these indices tend to grow large, I think it would be cool if there was a flag that would periodically remove them. probably a lot of users aren't aware that these take up so much space

Posted 3 years ago

AnxiousSeal95 I see what you're getting at, however this is more of an automated devops task and less of a server feature - in general, we're always much more careful when deleting stuff, and it's always advisable to have separate processes for backup and deletion that can be externally controlled, maintained and monitored.

Posted 3 years ago