Getting Data In

Why is Splunk not reading old data in a file?

ankithnageshshe
Path Finder

Hi Splunkers,

I recently ran into an issue where our Splunk forwarder is able to read and index the new lines in the file but not the old lines in the file that were written before configuring the monitoring.

Eg: I set monitor stanza at 3:00 pm for file abc.txt.....so any log that is written after 3:00 is indexed but logs before 3:00 are not indexed.

I tried again with crcSalt for no luck.

Any help is much appreciated.

Regards,
Ankith

0 Karma

mstjohn_splunk
Splunk Employee
Splunk Employee

hi @ankithnageshshetly

Did the answer below solve your problem? If so, please resolve this post by approving it!
If your problem is still not solved, keep us updated so that someone else can help ya. Thanks for posting!

0 Karma

MuS
SplunkTrust
SplunkTrust

Hi ankithnageshshetty,

check the inputs.conf for the following option:

followTail = [0|1]
* Whether or not the input should skip past current data in a monitored file
  for a given input stanza. This lets you skip over data in files, and
  immediately begin indexing current data.

Defaults to 0 but if set to 1, Splunk will start monitoring at the end of the file - like a tail -f ...

Hope this helps ...

cheers, MuS

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Introducing the 2026 - 2027 SplunkTrust cohort!

The goal of the SplunkTrust™ membership has historically been to acknowledge and recognize those who go above ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...