Getting Data In

CSV headers appear as event

ninisimonishvil
Path Finder

I have a CSV file that updates every now and then. I'm monitoring it via Splunk. However, the problem is that the first line of the file contains column names.

for example:

TIME;NAME;CAUSE;MONITOR;

and then comes the values 20190301;thename;problem; 1

I don't need column names to appear as an event. However, I was not able to find a solution that would work, I tried adding following lines in props.conf

HEADER_FIELD_LINE_NUMBER = 1
 HEADER_FIELD_DELIMITER = ;
 FIELD_DELIMITER = ;

But no success. suggestions?

Tags (2)
0 Karma

chrisyounger
SplunkTrust
SplunkTrust

This is one way you can do it: (ref: https://docs.splunk.com/Documentation/Splunk/7.2.4/Forwarding/Routeandfilterdatad#Discard_specific_e... )

In props.conf, set the TRANSFORMS-null attribute:

[your_sourcetype]
TRANSFORMS-null= discard_header_row

In transforms.conf:

[discard_header_row]
REGEX = ^\s*TIME,
DEST_KEY = queue
FORMAT = nullQueue

Hope this helps

0 Karma

tiagofbmm
Influencer

Have you tried the native CSV structured sourcetype in Splunk to parse that? The header wouldd be just fine:

[ csv ]
CHARSET=UTF-8
INDEXED_EXTRACTIONS=csv
KV_MODE=none
SHOULD_LINEMERGE=false
category=Structured
description=Comma-separated value format. Set header and other settings in "Delimited Settings"
disabled=false
pulldown_type=true

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Meet Splunk Observability Studio: AI-Assisted OpenTelemetry Instrumentation Without ...

Instrumentation is usually the last step or even an afterthought when building out a project. The feature ...

Federated Search for Cisco Security and Analytics Logging (SAL) is now GA on Splunk ...

Federated Search for Cisco  Security Analytics and Logging (SAL) is now generally available as part of the ...

Your Path to AgenticOps: AI Experiences for Every Splunk Practitioner

Your Path to AgenticOps: AI Experiences for Every Splunk Practitioner   Join us for a demo-driven look at how ...