Getting Data In

timestamp extraction from json

Ekino
Engager

Hi Splunk Gurus

 

Could you someone help me to resolve my Issue with timestamp extraction?

The Issue is that when I want to create a sourcetype with custom timestamp via advanced configuration

where I defined TIME_PREFIX as regular expression ^(?:[^\}\n]*\}){4},\{"\w+":"(?P<timestamp_ex>[^"]+) then timesstamp extraction is not working and I getting  error "failed to parse timestamp. Defaulting to file modtime."

regular expresion I got from splunk field extraction. Why Splunk doesn't accept my regex which was generated by Slunk itself? and tested out via regex101.com where the expression is working.

extract_fields.pngset_source_type.png

Labels (4)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

The TIME_PREFIX setting does not tell Splunk how to extract the timestamp field.  It merely tells Splunk where to *find* the timestamp.  The regex should describe the text that comes right before the timestamp.  There's no need for capture groups. 

As is normally the case with the Splunk field extractor, the regex it generates is overly verbose.  It's rarely necessary to describe everything from the beginning of the event until the timestamp - all you need is just enough to find the timestamp.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

Ekino
Engager

Thanks for your answer, it was helpfull

0 Karma

richgalloway
SplunkTrust
SplunkTrust

The TIME_PREFIX setting does not tell Splunk how to extract the timestamp field.  It merely tells Splunk where to *find* the timestamp.  The regex should describe the text that comes right before the timestamp.  There's no need for capture groups. 

As is normally the case with the Splunk field extractor, the regex it generates is overly verbose.  It's rarely necessary to describe everything from the beginning of the event until the timestamp - all you need is just enough to find the timestamp.

---
If this reply helps you, Karma would be appreciated.
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Laser Bananas and Edge Hubs: Exploring Operational Technology (OT) Data Through a ...

  OT is a different environment to traditional IT and can have interesting challenges when interfacing the ...

Event Series: Mastering AI Tokenomics and Splunk Agent Observability

Beyond the Black Box: Correlating AI Performance and Tokenomics with Splunk Agent Observability   As ...

span_metrics: The OpenTelemetry-Idiomatic Way to See Inside Your Services

You open a trace in Splunk Observability Cloud and everything looks fine. One root span, order-pipeline, with ...