Getting Data In

Single Index v/s Multiple Indexes

AnmolKohli
Explorer

We are moving from on-prem to cloud in splunk and as a part of this would want to know the index strategy that should be used?
We currently have different indexes for each application/service(200 indexes in total which would increase to 500 in next 2 years). What are the disadvantages and advantages of using multiple indexes as compared to single index and vice-versa? Would the queries be slow if we use a single index with multiple sourcetypes?i

0 Karma

tiagofbmm
Influencer

Well the answer is yes.

Adding to the security layer that having indexes enforces by using roles and their allowed to search list of indexes, splunk searches also gain from having separate indexes. The main reason is if you are searching an index that has a high number of sourcetypes and your search spreads through a specific time range, then Splunk would have to gzip more slices of data to check whether the data your are asking for is there or not.
If you are searching one index only, then even if you are searching in more than one bucket, at least you know that you are being more precise.

More, you can specify retention policies per index, not per sourcetype, so it eases up your life having them separated.

0 Karma

tiagofbmm
Influencer

Please let me know if the answer was useful for you. If it was, accept it and upvote. If not, give us more input so we can help you with that

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas     Cisco Live 2026 is almost here, and this ...

What Is the Name of the USB Key Inserted by Bob Smith? (BOTS Hint, Not the Answer)

Hello Splunkers,   So you searched, “what is the name of the usb key inserted by bob smith?”  Not gonna lie… ...

Automating Threat Operations and Threat Hunting with Recorded Future

    Automating Threat Operations and Threat Hunting with Recorded Future June 29, 2026 | Register   Is your ...