Getting Data In

Missing events from Splunk Universal Forwarder

iancorrea
Path Finder

I have one missing event out of 168 events from our Universal Forwarder. I've already checked the internal logs and the file has been indexed "Batch input finished reading file=", but I cannot find this source on my index. I also tried to expand time range and nothing appears, then check if the forwarder was restarted on the time of file was index, but it is not.

Settings on my forwarder is:

inputs.conf
[batch://my_path]
move_policy = sinkhole
disabled = false
sourcetype = my_sourcetype
index = my_index

outputs.conf
[tcpout]
defaultGroup = default-autolb-group-forwarder

[tcpout:default-autolb-group-forwarder]
disabled = false
server = myIndexer:9997
useACK = true

0 Karma

nickhills
Ultra Champion

Is this one event missing from a single log file?
(ie the log contains 168 events, and only 167 have been indexed)
Or is this one event from a batch of multiple files?

The reason I ask is that it could be that the missing event did not break properly and was either merged, or dropped.

If you still have the source log file, are you able to identify which event is missing, and does it appear "well formed" in the context of the other events?

If my comment helps, please give it a thumbs up!
0 Karma

manjunathmeti
Champion

Is there any extraction or parsing done on sourcetype 'my_sourcetype'?

0 Karma

iancorrea
Path Finder

yes, the other 167 events was successfully parsed

0 Karma

manjunathmeti
Champion

Since this is a small file, can you use monitor instead of batch and check?

0 Karma

iancorrea
Path Finder

I have been using batch since 1 month ago and there is no problem until this day. I cannot use the monitor because my client wants to use batch.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Accelerate Splunk App Development with AI

  Learn how to automate the repetitive parts of your build cycle.   Watch On-Demand   Replay the Accelerate ...

Splunk Agent Observability: Measuring AI Value with Splunk Tokenomics on AWS

The AI landscape is moving faster than ever, and our latest 2026 State of Observability report provides the ...

Enterprise Security Watch Party: What’s New in 8.8 - Recap

Splunk Community HQ hosted a Splunk Enterprise Security Watch Party: What’s New In ES 8.8 last Thursday. I had ...