Getting Data In

Best Practise: Different Log Sources

FRoth
Contributor

How do you handle different source types?

Do you create an index for every type of source i.e. an index called "unix" for all the logs coming from Linux, Solaris and Unix systems and an index "windows" for all Windows clients an servers.

That was my first impulse ...

Or do you receive everything into a "main" index and separate everything in the searches by appropriate search statements?

0 Karma
1 Solution

gkanapathy
Splunk Employee
Splunk Employee

Generally, put things in the same index unless you have a specific reason to do otherwise and understand how any why you would want it. The general reasons might include:

  • Differential data retention
  • Access control
  • Performance

Note that while the above are possible reasons or concerns, it doesn't mean that simply using more indexes is a solution, e.g., putting every single source into a different index will often make performance worse, or might make it better.

View solution in original post

0 Karma

gkanapathy
Splunk Employee
Splunk Employee

Generally, put things in the same index unless you have a specific reason to do otherwise and understand how any why you would want it. The general reasons might include:

  • Differential data retention
  • Access control
  • Performance

Note that while the above are possible reasons or concerns, it doesn't mean that simply using more indexes is a solution, e.g., putting every single source into a different index will often make performance worse, or might make it better.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...