Getting Data In

Adjust timezone for epoch style timestamp

morgancrocker
Engager

I have some log data that uses timestamps in an epoch-like format, but the issue is that they are logged as if it were in a local timezone rather than UTC. For example, 1394203884 = 14:51:24 March 6 2014 PST.

For example:

ts="1394187680", ...
ts="1394187682", ...
ts="1394187682", ...
ts="1394187682", ...

I understand that this an epoch-like forma and should always refer to UTC, but in this case it does not. Is there any way to configure Splunk to use these fields as timestamps, but not assume that they are UTC?

Update:

I should have mentioned this in the original post, I will update it. I have tried this(props.conf) and use it with other inputs, but Splunk does not seem to apply any TZ settings in this case. I believe this is because it identifies the timestamp as epoch time and assumes it is in UTC.

Tags (3)
0 Karma

lukejadamec
Super Champion

No. There are a number of posts on the topic, and to summarize them: Epoch time is UTC, and since Splunk will use the raw event timezone if one exists then Splunk will always regard epoch times as UTC.

Some things you can try:

Use another timestamp in the event if one exists.

Correct the app that is generating the bad timestamp.

Preprocess the events to correct the timestamp before sending them to the indexer.

yannK
Splunk Employee
Splunk Employee

By definition Epoch time is UTC.

http://www.unixtimestamp.com/index.php

The unix time stamp is a way to track time as a running total of seconds. This count starts at the Unix Epoch on January 1st, 1970 at UTC.

So the only solution is to rewrite your timestamp before splunk reads it.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Event Series: Splunk Observability Metrics Cost Optimization

Balancing Scale and Spend: Gaining Control Over High-Volume Metrics in Splunk Observability Cloud As ...

Kick the Tires Before You Commit: A Hands-On Tour of the Splunk Observability Cloud ...

Evaluating an enterprise observability platform usually goes like this: fill out a form, get a free trial with ...

Deep insights, no barriers: Splunk Observability Cloud Free Edition

As software delivery cycles continue to accelerate, observability shouldn’t be a luxury — it should be a ...