Splunk Search

What are the advantages and disadvantages of placing logs from multiple applications in different indexes?

NatWong
Explorer

Hi,

I am sending logs from multiple applications to SPLUNK. Would appreciate advice on what are the advantages/disadvantages of placing those apps logs in different indexes (i.e. applicationA_index , applicationB_index) as compared to one index.

Thanks in advance gurus !

Tags (1)
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

The hard reasons for separate indexes are retention time, maximum index size, and access restrictions.

If two logs end up in the same index, they will...

  • age out at the same time
  • get cleaned up upon occupying the same amount of disk space
  • are searchable by the same roles

A softer reason would be as an additional layer of hierarchy/structure to logically separate your data.
Another softer reason can be performance, for example if you have a very high volume source and a very low volume source. By separating the two you may improve search performance on the low volume source. I wouldn't compromise maintainability for this though unless you observe real issues.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

The hard reasons for separate indexes are retention time, maximum index size, and access restrictions.

If two logs end up in the same index, they will...

  • age out at the same time
  • get cleaned up upon occupying the same amount of disk space
  • are searchable by the same roles

A softer reason would be as an additional layer of hierarchy/structure to logically separate your data.
Another softer reason can be performance, for example if you have a very high volume source and a very low volume source. By separating the two you may improve search performance on the low volume source. I wouldn't compromise maintainability for this though unless you observe real issues.

Get Updates on the Splunk Community!

Observe and Secure All Apps with Splunk

  Join Us for Our Next Tech Talk: Observe and Secure All Apps with SplunkAs organizations continue to innovate ...

Splunk Decoded: Business Transactions vs Business IQ

It’s the morning of Black Friday, and your e-commerce site is handling 10x normal traffic. Orders are flowing, ...

Fastest way to demo Observability

I’ve been having a lot of fun learning about Kubernetes and Observability. I set myself an interesting ...