Getting Data In

How can I find out the max indexing delay, maybe by using the tstats command?

danielbb
Motivator

I would like to find out the max indexing delay per index.

| tstats max(_indextime - _time) where index=* by index

Throws the error -
-- Error in 'stats' command: The aggregation specifier 'max(_indextime' is invalid. The aggregation specifier must be in func_name format.

Tags (2)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

'_indextime - _time` is not a valid expression. You need to extract _indextime and _time separately and then find the difference.

| tstats latest(_time) AS _time latest(_indextime) AS _indextime where index=* by index | eval delta=_indextime - _time | ...
---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

'_indextime - _time` is not a valid expression. You need to extract _indextime and _time separately and then find the difference.

| tstats latest(_time) AS _time latest(_indextime) AS _indextime where index=* by index | eval delta=_indextime - _time | ...
---
If this reply helps you, Karma would be appreciated.

danielbb
Motivator

Useful thing, but does it really give back the max delay per index? or the latest delay per index?

0 Karma

richgalloway
SplunkTrust
SplunkTrust

It's the latest. Max(_time)==latest(_time). To find the true max would require reading every event in every index and performing stats max(eval(_indextime - _time)) on each. That would be very slow.

This query may help more. It shows the lag time per minute to help you identify when lags are happening.

| tstats latest(_time) AS time latest(_indextime) AS indextime where index=* by index, _time span=1m | eval delta=indextime - time | where delta>0
---
If this reply helps you, Karma would be appreciated.

danielbb
Motivator

That's great @richgalloway

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...