Getting Data In

Eventgen - Ensure current timestamp

ehqtrainorm
Explorer

Hi All,


I have a few existing inputs with EventGen (v6.5.2) and they work perfectly on Splunk 8.0.5.

The use case I am having trouble with is where:

a) The timestamp is not contained in the _raw data (the actual Production input uses the current index time)

b) There are other timestamps in _raw (they are not related to _time, are separate fields).

c) All events in the csv sample file must be ingested each interval.

 

I have tried both sample mode and replay mode.

Sample mode ingests the data but identifies different date/time values in _raw and uses that as _time, which is unexpected. This is even while autotimestamp = false.

ehqtrainorm_0-1598568180744.png

 

In replay mode, nothing is ingested due to errors where it can't find the timeField (there is a time column in the csv that I referenced).

 

So how can I ingest all events in the sample csv file while ensuring _time is the current time, and not dependent on any timestamps in the _raw?

 

Here is my config for mode = sample.

 

[ops_724events_ggprocdetail_sample]
disabled = false
mode = sample
interval = 60
sampletype = csv
autotimestamp=false

earliest = -1m
latest = now

 

Csv sample file has the following columns:

time,index,host,source,sourcetype,"_raw"

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Laser Bananas and Edge Hubs: Exploring Operational Technology (OT) Data Through a ...

  OT is a different environment to traditional IT and can have interesting challenges when interfacing the ...

Event Series: Mastering AI Tokenomics and Splunk Agent Observability

Beyond the Black Box: Correlating AI Performance and Tokenomics with Splunk Agent Observability   As ...