Getting Data In

How can I find out the max indexing delay, maybe by using the tstats command?

danielbb
Motivator

I would like to find out the max indexing delay per index.

| tstats max(_indextime - _time) where index=* by index

Throws the error -
-- Error in 'stats' command: The aggregation specifier 'max(_indextime' is invalid. The aggregation specifier must be in func_name format.

Tags (2)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

'_indextime - _time` is not a valid expression. You need to extract _indextime and _time separately and then find the difference.

| tstats latest(_time) AS _time latest(_indextime) AS _indextime where index=* by index | eval delta=_indextime - _time | ...
---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

'_indextime - _time` is not a valid expression. You need to extract _indextime and _time separately and then find the difference.

| tstats latest(_time) AS _time latest(_indextime) AS _indextime where index=* by index | eval delta=_indextime - _time | ...
---
If this reply helps you, Karma would be appreciated.

danielbb
Motivator

Useful thing, but does it really give back the max delay per index? or the latest delay per index?

0 Karma

richgalloway
SplunkTrust
SplunkTrust

It's the latest. Max(_time)==latest(_time). To find the true max would require reading every event in every index and performing stats max(eval(_indextime - _time)) on each. That would be very slow.

This query may help more. It shows the lag time per minute to help you identify when lags are happening.

| tstats latest(_time) AS time latest(_indextime) AS indextime where index=* by index, _time span=1m | eval delta=indextime - time | where delta>0
---
If this reply helps you, Karma would be appreciated.

danielbb
Motivator

That's great @richgalloway

0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...