Getting Data In

Single Index v/s Multiple Indexes

AnmolKohli
Explorer

We are moving from on-prem to cloud in splunk and as a part of this would want to know the index strategy that should be used?
We currently have different indexes for each application/service(200 indexes in total which would increase to 500 in next 2 years). What are the disadvantages and advantages of using multiple indexes as compared to single index and vice-versa? Would the queries be slow if we use a single index with multiple sourcetypes?i

0 Karma

tiagofbmm
Influencer

Well the answer is yes.

Adding to the security layer that having indexes enforces by using roles and their allowed to search list of indexes, splunk searches also gain from having separate indexes. The main reason is if you are searching an index that has a high number of sourcetypes and your search spreads through a specific time range, then Splunk would have to gzip more slices of data to check whether the data your are asking for is there or not.
If you are searching one index only, then even if you are searching in more than one bucket, at least you know that you are being more precise.

More, you can specify retention policies per index, not per sourcetype, so it eases up your life having them separated.

0 Karma

tiagofbmm
Influencer

Please let me know if the answer was useful for you. If it was, accept it and upvote. If not, give us more input so we can help you with that

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...

SplunkTrust Application Period is Officially OPEN!

It's that time, folks! The application/nomination period for the 2026-2027 SplunkTrust is officially open. If ...