Getting Data In

how to speed the files input process

cyue_splunk
Splunk Employee
Splunk Employee

If I have a directory containing many files to be added for file monitoring inputs, Splunk reads the files one by one. It'll take a long time if the files have a big size. Is there any way Splunk can read multiple files simultaneously to improve the inputs speed(not with multiple forwarders, just for one Splunk instance or one Forwarder instance )? Thanks!

Tags (2)
0 Karma

yannK
Splunk Employee
Splunk Employee

Not really, splunk indexers already go full speed by default.

Check your indexing queues queues with the sos app to find any bottleneck.
One remark about universal and lighweight forwarders : they have a limit of 256 kbps for the network speed. You can remove this limit.

Get Updates on the Splunk Community!

Developer Spotlight with Brett Adams

In our third Spotlight feature, we're excited to shine a light on Brett—a Splunk consultant, innovative ...

Index This | What can you do to make 55,555 equal 500?

April 2025 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with this ...

Say goodbye to manually analyzing phishing and malware threats with Splunk Attack ...

In today’s evolving threat landscape, we understand you’re constantly bombarded with phishing and malware ...