Getting Data In

Eventgen - Ensure current timestamp

ehqtrainorm
Explorer

Hi All,


I have a few existing inputs with EventGen (v6.5.2) and they work perfectly on Splunk 8.0.5.

The use case I am having trouble with is where:

a) The timestamp is not contained in the _raw data (the actual Production input uses the current index time)

b) There are other timestamps in _raw (they are not related to _time, are separate fields).

c) All events in the csv sample file must be ingested each interval.

 

I have tried both sample mode and replay mode.

Sample mode ingests the data but identifies different date/time values in _raw and uses that as _time, which is unexpected. This is even while autotimestamp = false.

ehqtrainorm_0-1598568180744.png

 

In replay mode, nothing is ingested due to errors where it can't find the timeField (there is a time column in the csv that I referenced).

 

So how can I ingest all events in the sample csv file while ensuring _time is the current time, and not dependent on any timestamps in the _raw?

 

Here is my config for mode = sample.

 

[ops_724events_ggprocdetail_sample]
disabled = false
mode = sample
interval = 60
sampletype = csv
autotimestamp=false

earliest = -1m
latest = now

 

Csv sample file has the following columns:

time,index,host,source,sourcetype,"_raw"

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

How to find the worst searches in your Splunk environment and how to fix them

Everyone knows Splunk is a powerful platform for running searches and doing data analytics. Your ...

Share Your Feedback: On Admin Config Service (ACS)!

Help Us Build a Better Admin Config Service Experience (ACS)   We Want Your Feedback on Admin Config Service ...