Logstash: is it possible to save documents in memo

Question

I am trying to save data in memory that I would be able to retrieve quickly in my filter part. Indeed, when i receive new documents i want to retrieve former documents related in order to compute some new metrics.

Can anyone tell me if it is possible and if yes how could I achieve that ?

Thank you very much.

Joe

Answer 1

The closest thing to achieve this would be to use the elasticsearch filter in order to query an ES cluster for some document or the unofficial memcached filter, which is probably more up to that task given the features of memcached.

I'm not aware of any official/unofficial redis or hazelcast filters, though, but that would also be an option since they are both caching technologies.

You should also have a look at the existing metrics filter which might also be of some help depending on your use case, which, by the way, you should detail a bit more if you desire more precise help.