Getting Data In

how to speed the files input process

cyue_splunk
Splunk Employee
Splunk Employee

If I have a directory containing many files to be added for file monitoring inputs, Splunk reads the files one by one. It'll take a long time if the files have a big size. Is there any way Splunk can read multiple files simultaneously to improve the inputs speed(not with multiple forwarders, just for one Splunk instance or one Forwarder instance )? Thanks!

Tags (2)
0 Karma

yannK
Splunk Employee
Splunk Employee

Not really, splunk indexers already go full speed by default.

Check your indexing queues queues with the sos app to find any bottleneck.
One remark about universal and lighweight forwarders : they have a limit of 256 kbps for the network speed. You can remove this limit.

Get Updates on the Splunk Community!

Splunk Enterprise Security: Your Command Center for PCI DSS Compliance

Every security professional knows the drill. The PCI DSS audit is approaching, and suddenly everyone's asking ...

Developer Spotlight with Guilhem Marchand

From Splunk Engineer to Founder: The Journey Behind TrackMe    After spending over 12 years working full time ...

Cisco Catalyst Center Meets Splunk ITSI: From 'Payments Are Down' to Root Cause in ...

The Problem: When Networks and Services Don't Talk Payment systems fail at a retail location. Customers are ...