Getting Data In

Splunk will index an individual file, but will not index multiple files in the same directory as the original file

New Member

We had been updating an index with data from an individual file. However over the course of time this file grows large and slows down processes dependent upon the file to submit updates. So we modified our input to use the same directory where the initial file was located and create a daily file for indexing. Splunk appears to recognize the files exist, however is not indexing any of the data from files contained in the directory. These are csv files and we removed the header so each file would have a new unique name with new data in each file. However this does not appear to have remediated the issue as files are created. Again, Splunk can see the file count and is accurate, but no data is being indexed.

Tags (3)
0 Karma


First thing is to determine whether Splunk is ignoring the file...

You can use the tailing processor url covered in this blog:

Or I use the input stats in Splunk on Splunk

Or check your logs...

My first guess would be that you either need a longer initcrclength or crcsalt = source more on these here:

0 Karma
Get Updates on the Splunk Community!

Detecting Remote Code Executions With the Splunk Threat Research Team

WATCH NOWRemote code execution (RCE) vulnerabilities pose a significant risk to organizations. If exploited, ...

Enter the Splunk Community Dashboard Challenge for Your Chance to Win!

The Splunk Community Dashboard Challenge is underway! This is your chance to showcase your skills in creating ...

.conf24 | Session Scheduler is Live!!

.conf24 is happening June 11 - 14 in Las Vegas, and we are thrilled to announce that the conference catalog ...