Getting Data In

how to speed the files input process

cyue_splunk
Splunk Employee
Splunk Employee

If I have a directory containing many files to be added for file monitoring inputs, Splunk reads the files one by one. It'll take a long time if the files have a big size. Is there any way Splunk can read multiple files simultaneously to improve the inputs speed(not with multiple forwarders, just for one Splunk instance or one Forwarder instance )? Thanks!

Tags (2)
0 Karma

yannK
Splunk Employee
Splunk Employee

Not really, splunk indexers already go full speed by default.

Check your indexing queues queues with the sos app to find any bottleneck.
One remark about universal and lighweight forwarders : they have a limit of 256 kbps for the network speed. You can remove this limit.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Rounding off the Splunk Dashboard Contest

What does a contest-winning Splunk dashboard look like? In this case, it isn't in a browser tab at all. It ...

A Four Part Event Series: AI + Observability: AI Agents, LLMs, Apps, & Infrastructure

AI + Observability: AI Agents, LLMs, Apps, & Infrastructure The rapid evolution of artificial intelligence ...

Splunk Technical Support Is Moving to Cisco Support Tools

Introduction Splunk technical support is transitioning to Cisco’s support environment. This change brings ...