All Apps and Add-ons

Getting time difference in Splunk and AWS logs ? How to trouble shoot this issue ?

Hemnaath
Motivator

Hi All, We could see a time difference in timing between splunk and AWS logs for same query (lambda, unique identifier) We observe 3 minutes of time difference between Splunk and AWS logs

When executed the below query we could see some 

index="XXX" sourcetype=unify:ticketwork source=*api-gateway-logs-xxxx/ticketwork* "\"activityName\":\"createWorkTicket\"" *INCIDNETNO12144*
| eval delay_sec=_indextime - _time
| timechart span=1d min(delay_sec) avg(delay_sec) max(delay_sec) by host

minimum delay in sec =21.59
maximum delay in sec =203.92
avg delay in sec =112.755

index="XXX" sourcetype=unify:ticketwork source=*api-gateway-logs-xxxx/ticketwork* "\"activityName\":\"createWorkTicket\"" *INCIDNETNO12144*

| eval indexed_time=strftime(_indextime,"%+")
| eval latency=_indextime - _time
| table _time,indexed_time,latency,index,_raw

latency is  203.92 sec

latency is 21.59 sec 

Can you guide me what are steps should be considered to start troubleshooting this issue.

 

Labels (1)
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Design, Compete, Win: Submit Your Best Splunk Dashboards for a .conf26 Pass

Hello Splunkers,  We’re excited to kick off a Splunk Dashboard contest! We know that dashboards are a primary ...

May 2026 Splunk Expert Sessions: Security & Observability

Level Up Your Operations: May 2026 Splunk Expert Sessions Whether you are refining your security posture or ...

Network to App: Observability Unlocked [May & June Series]

In today’s digital landscape, your environment is no longer confined to the data center. It spans complex ...