Knowledge Management

Can I increase the number of backfill threads higher than 16

approachct
Path Finder

Is there a way to increase the number of maximum threads that the backfill script will use to a value higher than 16?

Tags (1)
0 Karma

gkanapathy
Splunk Employee
Splunk Employee

You could simply edit or copy and edit the fill_summary_index.py script by hand. However, you will still be limited by settings for the max number of concurrent search jobs in the Splunk server set in limits.conf. These vary depending on the number of CPU cores you have and by default is 4+(4*n_cores), but you can edit these parameters as well. If your machine has

  • More than 16 CPU cores, and
  • Pretty high disk IOPs

you can get through the jobs faster. Otherwise, you'll bottleneck on one of these resources.

Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...