Getting Data In

Eventgen - Ensure current timestamp

ehqtrainorm
Explorer

Hi All,


I have a few existing inputs with EventGen (v6.5.2) and they work perfectly on Splunk 8.0.5.

The use case I am having trouble with is where:

a) The timestamp is not contained in the _raw data (the actual Production input uses the current index time)

b) There are other timestamps in _raw (they are not related to _time, are separate fields).

c) All events in the csv sample file must be ingested each interval.

 

I have tried both sample mode and replay mode.

Sample mode ingests the data but identifies different date/time values in _raw and uses that as _time, which is unexpected. This is even while autotimestamp = false.

ehqtrainorm_0-1598568180744.png

 

In replay mode, nothing is ingested due to errors where it can't find the timeField (there is a time column in the csv that I referenced).

 

So how can I ingest all events in the sample csv file while ensuring _time is the current time, and not dependent on any timestamps in the _raw?

 

Here is my config for mode = sample.

 

[ops_724events_ggprocdetail_sample]
disabled = false
mode = sample
interval = 60
sampletype = csv
autotimestamp=false

earliest = -1m
latest = now

 

Csv sample file has the following columns:

time,index,host,source,sourcetype,"_raw"

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

ATTENTION: We’re Moving! (AGAIN!)

The Splunk Community Slack is undergoing a system migration to keep our workspace secure and ...

Deep Dive: Optimizing Telemetry Pipelines in Splunk Observability Cloud

In this session, we will peel back the layers of Splunk Observability Cloud’s cost-optimization features. ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...