Getting Data In

Is this a correct way to measure AWS CloudTrail ingest lag?

esalesap
Path Finder

Using the following search, I'm seeing AWS CloudTrail ingest lag between 4 and 9 hours.

index=ibp_aws sourcetype=aws:cloudtrail*
| eval lag=round((_indextime - _time)/60,1)
| bin _time span=10m
| stats max(lag) AS xLagH min(lag) AS nLagH count by _indextime
| eval _time=_indextime
| timechart span=10m max(xLagH) min(nLagH) sum(count)

If the search is correct, any idea why AWS CloudTrail ingest would lag
like this? I'm on Splunk Enterprise 7.0.1 and Splunk_TA_aws 4.4.0.

laurenschwerdt
Explorer

Did you ever get an answer on this? 

0 Karma
Get Updates on the Splunk Community!

Webinar Recap | Revolutionizing IT Operations: The Transformative Power of AI and ML ...

The Transformative Power of AI and ML in Enhancing Observability   In the realm of IT operations, the ...

.conf24 | Registration Open!

Hello, hello! I come bearing good news: Registration for .conf24 is now open!   conf is Splunk’s rad annual ...

ICYMI - Check out the latest releases of Splunk Edge Processor

Splunk is pleased to announce the latest enhancements to Splunk Edge Processor.  HEC Receiver authorization ...