Splunk Cloud Platform

ingesting csv headers with double quotes and %

narenpg
Explorer

I am trying to ingest a csv file which has headers with double quotes " and %. They are separated by comma. But after ingestion if two field names has same name except one has # and the other one has % then it merges both of them into one field while using table output. How to fix this issue. If splunk does`nt support csv headers then i have to remove before ingesting them. Any ideas.

Labels (2)
0 Karma

livehybrid
SplunkTrust
SplunkTrust

Hi @narenpg 

You need to use FIELD_NAMES in your props to set the field names in this case,:

eg

FIELD_NAMES=name,count,count_perc,region

 

for this test CSV:

 

"name","count","count%","region"
"John Smith","245","12.3%","North"
"Mary Johnson","189","9.5%","South" 
"James Williams","167","8.4%","East"
"Sarah Davis","156","7.8%","West"
"Michael Brown","143","7.2%","North"
"Jennifer Wilson","134","6.7%","South"
"Robert Taylor","128","6.4%","East"
"Elizabeth Anderson","112","5.6%","West"
"David Martinez","98","4.9%","North"
"Susan Thompson","87","4.4%","South"

livehybrid_0-1741109523407.png

 

Please let me know how you get on and consider adding karma to this or any other answer if it has helped.
Regards

Will

0 Karma

narenpg
Explorer

This seems to be working in the "Add Data" testing, but after adding this sourcetype when i search i dont see the headers. Actually the header starts on line 2, so i added "File Preamble" to skip the first line and start ingesting the headers from line 2 but it is skipping it. What am i missing?

 
 
Tags (1)
0 Karma
Get Updates on the Splunk Community!

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...