Quick use case : Splitt big index into daily indexes with _reindex APILet's suppose you have a large timeseries index that holds multiple days, months or years of data and you want to split it into daily, weekly or monthly timeseries index. Let's talk the following example of timeseries metrics ingested into the same i...Jan 10, 2021 · 2 min readsynapticiel.hashnode.dev
Quick use case : remove daily indices older than 90 days with ILMIn this short post i will not dive into considerations on why i use daily indices instead of using a global ILM policy that will rollover and organize the data ..., in my daily basis dealing with duplicates is a must and this is not supported by roll...Jan 8, 2021 · 3 min readsynapticiel.hashnode.dev
Quick use case : clean index mapping with reindexing dataBy mistake i added some documents to my elasticsearch index without providing an explicit mapping, elasticsearch did the job and add a default mapping like this : { "account_id": { "type": "text", "fields": { "keyword": { "typ...Jan 7, 2021 · 4 min readsynapticiel.hashnode.dev
Quick use case : Remove a field from a batch of documents in elasticsearch indexI have an index that holds some inventory data from network devices, and tried to update these documents using logstash with other attributes from differents systems like billing. Surprise! after 2 hours of batch running with logstash, i discovered t...Jan 6, 2021 · 2 min readsynapticiel.hashnode.dev
Quick use case : Denormalizing data with logstashIf you want to load the following data into elasticsearch, you will need to make some changes so you can create interesting tranforms and visualizations in kibana The better would be to ingest data into elasticsearch with the following denormalized ...1ODec 30, 2020 · 3 min readsynapticiel.hashnode.dev