Monitoring Splunk

Configuration to achieve better performance of Splunk

swatishs
Explorer

I want to carry out performance monitoring of Splunk. I came across this benchmark while browsing https://docs.splunk.com/Documentation/Splunk/6.1.14/Installation/Referencehardware. What was the configuration in config files like limits.conf and indexes.conf while carrying out these measurements? Were some parameters like memPoolMB or max_mem_usage_mb tuned to achieve better performance or were the set to their default configuration only?

0 Karma

nickhills
Ultra Champion

The Reference hardware and sizing guides are based on not making any changes to limits.conf.

Adjustments to limits tends to be tuning around large event types, lookups or other environmental peculiarities you have in your environment. the default limits.conf should be optimized for a 'standard' Splunk deployment.

The same is true for indexes.conf, with some subtle nuances.

The reference spec includes storage with a defined rate of IOPS.
You should configure your hot/warm data to exist on your fastest storage device, as you want to be able to read/write as quickly as possible.
Your use case for data life-cycle management dictates after how old(big) your warm data gets before it gets moved to cold.
If you have two tiers of storage (ssd & spinning disk) there are advantages to separating the index paths, putting cold on the slower disk, but the reference indexing capabilities are primarily concerned with the indexers ability (and the IOPS) taken to write hot/warm.

If my comment helps, please give it a thumbs up!
0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Unlock What’s Next: The Splunk Cloud Platform at .conf25

In just a few days, Boston will be buzzing as the Splunk team and thousands of community members come together ...