Splunk Enterprise

What kind of things do you view as "bad config"?

muebel
SplunkTrust
SplunkTrust

This is kind of open ended, but essentially I'm looking for things that you view as bad config, or at least configuration settings that should be flagged for review.

Some ideas I've had so far:

- Indexes with a very short retention period (100 seconds or the like)
- Searches with `index=*` in them
- A deployment server targeturi that doesn't match the name of your actual DS

What other sorts of config would you flag as concerning? Do you have any automated checks for anything like this in house?

Labels (2)
0 Karma
1 Solution

isoutamo
SplunkTrust
SplunkTrust

Hi

some other issues which I always try to avoid/fix

  • indexes.conf without volumes
  • KO stored under search app
  • No naming policy for Splunk KOs
  • use system/local instead of separate apps for local configurations
  • non indexer layer nodes without internal log forwarding to indexers
  • no MC installed / configured
  • no email configured
  • no kvstore backups
  • no own Splunk Apps for different groups/business apps
  • no separate test/prod environments
  • no index / sourcetype policies
  • no source system integration catalog from where you could see what and why you have stuff and to whom contact based on issues
  • IPs have used instead of FQDN, use always at least meaningful CNAME for all nodes

Definitely there are a lot more items, here was what comes my mind without thinking.

r. Ismo

View solution in original post

0 Karma

PickleRick
SplunkTrust
SplunkTrust

TLS certs issued to IP addresses

"Sharing" certs among multiple clients (multiple servers too but I can find legitimate use cases for it).

All scheduled searches with the same schedule.

No sound method of source health monitoring (that's more of an organizational/policy issue than config but some internal splunk-based automation would surely be helpful here).

Searches with tons of rex commands (create the extractions already!).

Abuse of append in searches (usualy by users "extending" old searches in dashboards without really understanding SPL).

Searches with eval _time=something. Often that's a badly onboarded source (but can be legit use case so it's up for review, not necessarily automatic red flag).

Using obsolete tls version and/or weak cipher suites.

Using default certs when tls is enabled.

0 Karma

isoutamo
SplunkTrust
SplunkTrust

Hi

some other issues which I always try to avoid/fix

  • indexes.conf without volumes
  • KO stored under search app
  • No naming policy for Splunk KOs
  • use system/local instead of separate apps for local configurations
  • non indexer layer nodes without internal log forwarding to indexers
  • no MC installed / configured
  • no email configured
  • no kvstore backups
  • no own Splunk Apps for different groups/business apps
  • no separate test/prod environments
  • no index / sourcetype policies
  • no source system integration catalog from where you could see what and why you have stuff and to whom contact based on issues
  • IPs have used instead of FQDN, use always at least meaningful CNAME for all nodes

Definitely there are a lot more items, here was what comes my mind without thinking.

r. Ismo

0 Karma

TRex
SplunkTrust
SplunkTrust

Something that always catches my attention, and requires review:

 

[default]

 

the default stanza

0 Karma

muebel
SplunkTrust
SplunkTrust

ah yeah. Seems like it might be appropriate in some settings. Are there config files where it's particularly egregious?

0 Karma
Get Updates on the Splunk Community!

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...

Updated Team Landing Page in Splunk Observability

We’re making some changes to the team landing page in Splunk Observability, based on your feedback. The ...