Getting Data In

Problem with time in Edge Processor

adrifesa95
Engager

Hello,

I am receiving darktrace events through my Edge Processor as a Forwarder and I am a bit new to the SPL2 pipeline. It can probably be solved by transforming something in the pipeline.

The problem is that I am indexing events with a _time of -5h and a 2h difference from the event time stamp. Here is an example:

adrifesa95_1-1712747276840.png

 

Time in the Edge Processor:

adrifesa95_0-1712747181181.png

It should be noted that the rest of the events that I ingest through this server are arriving at the correct time.

Labels (2)
0 Karma

adrifesa95
Engager

Yes, but nothing relevant

0 Karma

bowesmana
SplunkTrust
SplunkTrust

Look at the raw text rather than the JSON to see what Splunk may be using for timestamp detection. The JSON view is sorted and Splunk will only look a certain distance into the event to detect a timestamp (128 bytes by default).

If it cannot find a timestamp, then it will use current time

https://docs.splunk.com/Documentation/Splunk/9.2.1/Admin/Propsconf#Timestamp_extraction_configuratio...

0 Karma

adrifesa95
Engager

Here the raw:
adrifesa95_0-1712821023278.png

 

0 Karma

bowesmana
SplunkTrust
SplunkTrust

That looks like it is more than 128 characters into the event, so you should set up MAX_TIMESTAMP_LOOKAHEAD and optionally TIME_PREFIX for your sourcetype for that data.

 

0 Karma

adrifesa95
Engager

How can I do this? Note that the forwarder is an Edge Processor and you can't touch the conf files, everything is modified in the GUI.

0 Karma

bowesmana
SplunkTrust
SplunkTrust

OK, I'm unsure where the time will get extracted, but have you looked at this document

https://docs.splunk.com/Documentation/SplunkCloud/9.1.2312/EdgeProcessor/TimeExtractionPipeline

 

0 Karma

adrifesa95
Engager

yes...

0 Karma
Get Updates on the Splunk Community!

Unlock Database Monitoring with Splunk Observability Cloud

  In today’s fast-paced digital landscape, even minor database slowdowns can disrupt user experiences and ...

Purpose in Action: How Splunk Is Helping Power an Inclusive Future for All

At Cisco, purpose isn’t a tagline—it’s a commitment. Cisco’s FY25 Purpose Report outlines how the company is ...

[Upcoming Webinar] Demo Day: Transforming IT Operations with Splunk

Join us for a live Demo Day at the Cisco Store on January 21st 10:00am - 11:00am PST In the fast-paced world ...