Getting Data In

Why am I unable to index a file if the size is too small? Is there a minimum file size setting?

gauravmishra15
Path Finder

Hi Friends,

I am facing an issue where SPLUNK does not index a file if the size is too low. The file sits in a UNC location(NAS), therefore, I created a data input to monitor the file. Splunk started indexing this file when the file size increased (I believe more than 800KB).

I believe Splunk has a limit to indicate the minimum file size to be indexed. Please help me finding the setting and overriding it.

renjith_nair
Legend

Hi Gaurav,

There shouldn't be any minimum size for file to monitor. I have just configured file of size 126 bytes and it monitors. Splunk monitors the file and picks up the events if it has any content inside. The only possibility is that the file was indexed earlier and hence it didn't index again. Splunk checks first few bytes to determine if the file was already read

---
What goes around comes around. If it helps, hit it with Karma 🙂
0 Karma
Get Updates on the Splunk Community!

🔐 Trust at Every Hop: How mTLS in Splunk Enterprise 10.0 Makes Security Simpler

From Idea to Implementation: Why Splunk Built mTLS into Splunk Enterprise 10.0  mTLS wasn’t just a checkbox ...

Observe and Secure All Apps with Splunk

  Join Us for Our Next Tech Talk: Observe and Secure All Apps with SplunkAs organizations continue to innovate ...

Splunk Decoded: Business Transactions vs Business IQ

It’s the morning of Black Friday, and your e-commerce site is handling 10x normal traffic. Orders are flowing, ...