Getting Data In
Highlighted

Selectively ignoring fields in CSV input?

Builder

Hey everyone. I am trying to input .csv files. The issue with the files is that the software generating them includes the timestamp numerous times in each line. Here's a rough example:

timestamp,CPU Usage, timestamp, Memory usage, timestamp, temperature, timestamp, license usage, timestamp, SNMP reachability

You get the idea. I don't want to waste space indexing all of the extra timestamp fields. Any advice?

Tags (1)
0 Karma
Highlighted

Re: Selectively ignoring fields in CSV input?

Splunk Employee
Splunk Employee

You can use an index time TRANSFORM, or more likely a SEDCMD to modify the data before it goes into the index: http://www.splunk.com/base/Documentation/4.1.6/Admin/Anonymizedatawithsed

0 Karma