Join the Conversation
- Find Answers
- :
- Splunk Administration
- :
- Getting Data In
- :
- universal forwarder delay - 8 minutes
- Subscribe to RSS Feed
- Mark Topic as New
- Mark Topic as Read
- Float this Topic for Current User
- Bookmark Topic
- Subscribe to Topic
- Mute Topic
- Printer Friendly Page
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Any ideas why I am seeing an 8 minute delay in the UF -> Index data?
The UF is monitoring a logfile that is consistently generating realtime data. When I view the index from my SH, I am unable to see anything before 8 minutes. I am currently using a cluster: 1SH, (1indx+1indx) RF2 SF2 cluster, Master, UF w/ index autodiscover set ... And it seems all other index are reacting in the same way so I am assuming this is a global setting somewhere. I'm currently reading up on limits.conf and pipeline/parallel parellization.
Thank You,
Sean
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I would search _internal for indications that pipelines are blocked or paused. In all likelihood, your indexer is not up to the indexing load being presented to it. Either slow disk or not enough CPU. If you have many cores, you could try adding pipelines. Otherwise, an additional indexer may be your answer. (1 extra pipeline will result in 10-12 CPUs being used, total, for indexing. Don't add a parallel pipeline unless you have many more cores than that still available for searching.)
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
I would search _internal for indications that pipelines are blocked or paused. In all likelihood, your indexer is not up to the indexing load being presented to it. Either slow disk or not enough CPU. If you have many cores, you could try adding pipelines. Otherwise, an additional indexer may be your answer. (1 extra pipeline will result in 10-12 CPUs being used, total, for indexing. Don't add a parallel pipeline unless you have many more cores than that still available for searching.)
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Here are some troubleshooting steps for the same
see this first
http://docs.splunk.com/Documentation/Splunk/6.3.3/Troubleshooting/Troubleshootingeventsindexingdelay
https://answers.splunk.com/answers/39211/why-am-i-seeing-indexing-lag.html
https://answers.splunk.com/answers/247513/what-is-the-source-of-indexing-lag-and-how-to-fix.html
Unlock Database Monitoring with Splunk Observability Cloud
Purpose in Action: How Splunk Is Helping Power an Inclusive Future for All
[Upcoming Webinar] Demo Day: Transforming IT Operations with Splunk
