Getting Data In

How to prevent scripted input grouping events by time?

temperuser
Explorer

I have a script that executes every 5 minutes. It extracts date and time with props.conf:

EXTRACT-date = ^(?:[^\t\n]*\t){3}(?P<date>[^\t]+)
EXTRACT-time = ^(?:[^\t\n]*\t){4}(?P<time>[^\t]+)
TIMESTAMP_FIELDS = date,time
TIME_FORMAT = %Y-%m-%d %H:%M:%S
TZ = GMT

I have time field with actually values of event time, but splunk timestamps are grouped by 5 minutes (script execution period). Why is it so, and how I can prevent this behaviour?

Tags (1)
0 Karma
1 Solution

martin_mueller
SplunkTrust
SplunkTrust

That's not how timestamp extraction works. Without knowing your data format, I'd guess this might work:

[your_sourcetype]
TIME_PREFIX = ^([^\t\r\n]*\t){3}
TIME_FORMAT = %Y-%m-%d\t%H:%M:%S
MAX_TIMESTAMP_LOOKAHEAD = 30
TZ = GMT

Note, I didn't test if the tab between date and time needs to be a tab character or the baslash-tee of regex.

The basic Idea is to tell Splunk where to start looking, what to look for, and for how far to keep looking.
EXTRACT-foo is search-time field extraction, entirely unrelated to finding the timestamp at index time.

View solution in original post

martin_mueller
SplunkTrust
SplunkTrust

That's not how timestamp extraction works. Without knowing your data format, I'd guess this might work:

[your_sourcetype]
TIME_PREFIX = ^([^\t\r\n]*\t){3}
TIME_FORMAT = %Y-%m-%d\t%H:%M:%S
MAX_TIMESTAMP_LOOKAHEAD = 30
TZ = GMT

Note, I didn't test if the tab between date and time needs to be a tab character or the baslash-tee of regex.

The basic Idea is to tell Splunk where to start looking, what to look for, and for how far to keep looking.
EXTRACT-foo is search-time field extraction, entirely unrelated to finding the timestamp at index time.

Get Updates on the Splunk Community!

Unlock Database Monitoring with Splunk Observability Cloud

  In today’s fast-paced digital landscape, even minor database slowdowns can disrupt user experiences and ...

Purpose in Action: How Splunk Is Helping Power an Inclusive Future for All

At Cisco, purpose isn’t a tagline—it’s a commitment. Cisco’s FY25 Purpose Report outlines how the company is ...

[Upcoming Webinar] Demo Day: Transforming IT Operations with Splunk

Join us for a live Demo Day at the Cisco Store on January 21st 10:00am - 11:00am PST In the fast-paced world ...