Getting Data In

Best Practise: Different Log Sources

FRoth
Contributor

How do you handle different source types?

Do you create an index for every type of source i.e. an index called "unix" for all the logs coming from Linux, Solaris and Unix systems and an index "windows" for all Windows clients an servers.

That was my first impulse ...

Or do you receive everything into a "main" index and separate everything in the searches by appropriate search statements?

0 Karma
1 Solution

gkanapathy
Splunk Employee
Splunk Employee

Generally, put things in the same index unless you have a specific reason to do otherwise and understand how any why you would want it. The general reasons might include:

  • Differential data retention
  • Access control
  • Performance

Note that while the above are possible reasons or concerns, it doesn't mean that simply using more indexes is a solution, e.g., putting every single source into a different index will often make performance worse, or might make it better.

View solution in original post

0 Karma

gkanapathy
Splunk Employee
Splunk Employee

Generally, put things in the same index unless you have a specific reason to do otherwise and understand how any why you would want it. The general reasons might include:

  • Differential data retention
  • Access control
  • Performance

Note that while the above are possible reasons or concerns, it doesn't mean that simply using more indexes is a solution, e.g., putting every single source into a different index will often make performance worse, or might make it better.

0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...