Getting Data In

watched file not being indexed completely (data being indexed is truncated)

Conradj
Path Finder

Hi,

I have a file on a server that i want to index. I have an app that watches this file and indexes it.

The file contains an output of server metric data and is essentially in the format of "key = value","key = value" and so on.

This file gets overwritten with new data every 60s.

Recently I noticed that the some metrics were dropping off, i checked the file and it is complete. but when i check the source in Splunk i can clearly see that it has been truncated.

Nothing else on the server has changed. I have checked the logs on the universal forwarder, but I could not see anything that stood out.

ideas welcome!

C.

0 Karma

lguinn2
Legend

How long are your events? If your events are many lines long, or a single line is very long, you may need to increase some limits. Here is a great entry that covers this:
Size limit for an event

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas     Cisco Live 2026 is almost here, and this ...

What Is the Name of the USB Key Inserted by Bob Smith? (BOTS Hint, Not the Answer)

Hello Splunkers,   So you searched, “what is the name of the usb key inserted by bob smith?”  Not gonna lie… ...

Automating Threat Operations and Threat Hunting with Recorded Future

    Automating Threat Operations and Threat Hunting with Recorded Future June 29, 2026 | Register   Is your ...