Splunk Cloud Platform

ingesting csv headers with double quotes and %

narenpg
Explorer

I am trying to ingest a csv file which has headers with double quotes " and %. They are separated by comma. But after ingestion if two field names has same name except one has # and the other one has % then it merges both of them into one field while using table output. How to fix this issue. If splunk does`nt support csv headers then i have to remove before ingesting them. Any ideas.

Labels (2)
0 Karma

livehybrid
SplunkTrust
SplunkTrust

Hi @narenpg 

You need to use FIELD_NAMES in your props to set the field names in this case,:

eg

FIELD_NAMES=name,count,count_perc,region

 

for this test CSV:

 

"name","count","count%","region"
"John Smith","245","12.3%","North"
"Mary Johnson","189","9.5%","South" 
"James Williams","167","8.4%","East"
"Sarah Davis","156","7.8%","West"
"Michael Brown","143","7.2%","North"
"Jennifer Wilson","134","6.7%","South"
"Robert Taylor","128","6.4%","East"
"Elizabeth Anderson","112","5.6%","West"
"David Martinez","98","4.9%","North"
"Susan Thompson","87","4.4%","South"

livehybrid_0-1741109523407.png

 

Please let me know how you get on and consider adding karma to this or any other answer if it has helped.
Regards

Will

0 Karma

narenpg
Explorer

This seems to be working in the "Add Data" testing, but after adding this sourcetype when i search i dont see the headers. Actually the header starts on line 2, so i added "File Preamble" to skip the first line and start ingesting the headers from line 2 but it is skipping it. What am i missing?

 
 
Tags (1)
0 Karma
Get Updates on the Splunk Community!

Index This | Why did the turkey cross the road?

November 2025 Edition  Hayyy Splunk Education Enthusiasts and the Eternally Curious!   We’re back with this ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Feel the Splunk Love: Real Stories from Real Customers

Hello Splunk Community,    What’s the best part of hearing how our customers use Splunk? Easy: the positive ...