It should be stated up-front that indexes cannot be reduced in size. You must wait for buckets to be frozen for data to go away. The best you can do is reduce how much is stored in new buckets. You've already taken a good first step by eliminating duplicate events. Next, look at indexed fields. Fields are best extracted at search-time rather than at index-time. Doing so helps indexer performance, saves space in the indexes, and offers more flexibility with fields. Look at the INDEXED_EXTRACTIONS settings in your props.conf files. Each of them will create index-time fields. JSON data is especially verbose so KV_MODE=json should be used, instead.
... View more