Getting Data In

CSV Source not getting field headers.

JDukeSplunk
Builder

What am I doing wrong?
I am trying to get fields from a csv. I imported one csv file into a standalone Splunk server using the "add data" GUI. It picked up the header and displayed the fields perfectly. I then took the props.conf lines it generated and placed it on my indexer in /etc/system/local/props.conf. I then did a /debug/refresh on the indexer to reload the props.conf. When that didn't work I placed the props.conf alongside the inputs.conf on the forwarding host.. Neither worked.

When I ingest the data, there are no fields, just single line-by-lines.

alt text

My configs.

Inputs.conf

[monitor://E:\Health_Data_Fax_QA\Reporting\*(log$|txt$|csv$)]
disabled = 0
followTail = 0
sourcetype=hdfax:qa
ignoreOlderThan = 30d
index = application
crcSalt = 

[monitor://E:\Health_Data_Fax_UAT\Reporting\*(log$|txt$|csv$)]
disabled = 0
followTail = 0
sourcetype=hdfax:uat
ignoreOlderThan = 30d
index = application
crcSalt = 

props.conf

[hdfax:qa]
DATETIME_CONFIG = 
INDEXED_EXTRACTIONS = csv
KV_MODE = none
LINE_BREAKER = ([\r\n]+)
NO_BINARY_CHECK = true
SHOULD_LINEMERGE = false
category = Structured
description = Comma-separated value format. Set header and other settings in "Delimited Settings"
disabled = false
pulldown_type = true


[hdfax:uat]
DATETIME_CONFIG = 
INDEXED_EXTRACTIONS = csv
KV_MODE = none
LINE_BREAKER = ([\r\n]+)
NO_BINARY_CHECK = true
SHOULD_LINEMERGE = false
category = Structured
description = Comma-separated value format. Set header and other settings in "Delimited Settings"
disabled = false
pulldown_type = true
0 Karma
1 Solution

JDukeSplunk
Builder

The forwarder had to be upgraded to get the proper csv extractions. 6.5.2 did not do it, 7.2.3 did.

For complete info see this

https://answers.splunk.com/answers/739964/need-sedcmd-help.html

View solution in original post

0 Karma

JDukeSplunk
Builder

The forwarder had to be upgraded to get the proper csv extractions. 6.5.2 did not do it, 7.2.3 did.

For complete info see this

https://answers.splunk.com/answers/739964/need-sedcmd-help.html

0 Karma

skalliger
Motivator

Your sample event has a different sourcetype than the ones listed in the props.

Is your standalone server a test server? Because later you're talking about moving the props.conf to the indexer.

Edit: Actually, it should be enough when you have the props.conf on your Universal Forwarder already and the config file should not be needed on your indexer.

Skalli

0 Karma

JDukeSplunk
Builder

Thanks for your input.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...

SplunkTrust Application Period is Officially OPEN!

It's that time, folks! The application/nomination period for the 2026-2027 SplunkTrust is officially open. If ...