Splunk Search

how to extract field from csv raw data

ravir_jbp
Explorer

below csv file getting generated which is ingested into splunk. These are the file counts created date wise on different folders. My rex command does not pickup the date, filepath and count. Please help how we can extract these field from below csv raw data.

 

"Date","Folder","FileCount"
"11-07-2023","E:\Intra\I\IE\Processed\Error","381"
"11-08-2023","E:\Intra\I\IE\Processed\Error","263"
"11-09-2023","E:\Intra\I\IE\Processed\Error","223"
"11-10-2023","E:\Intra\I\IE\Processed\Error","133"
"11-11-2023","E:\Intra\I\IE\Processed\Error","3"
"11-12-2023","E:\Intra\I\IE\Processed\Success","4"
"11-13-2023","E:\Intra\I\IE\Processed\Success","4"","218"
"11-14-2023","E:\Intra\I\IE\Processed\Success","4"","200"
"11-15-2023","E:\Intra\I\IE\Processed\Error","284"

Labels (1)
Tags (1)
0 Karma

inventsekar
SplunkTrust
SplunkTrust

Hi @ravir_jbp ... for the data already logged into splunk, do you want to use Splunk Search query and get some results? (and maybe do you want to create dashboard/alert/report) 

or

do you want to onboard/ingest some csv files, but the field extraction not working as expected, please suggest, thanks. 

0 Karma

PickleRick
SplunkTrust
SplunkTrust

What do you mean by "my rex command does not pick up the date, filepath and count"?

This is structured data and can be onboarded as such with INDEXED_EXTRACTIONS=csv

0 Karma

ravir_jbp
Explorer

@PickleRick  can you please provide me more information on this

0 Karma

PickleRick
SplunkTrust
SplunkTrust

https://docs.splunk.com/Documentation/Splunk/9.1.1/Data/Extractfieldsfromfileswithstructureddata

Otherwise, if your field order is constant, you can simply parse them out with a regex indeed. But it should be relatively simple - something like

^"(?<field1>.*)","(?<field2>.*)","(?<field3>.*)"$

You have to be careful not to end your match early if you get some escaped quotes earlier in the event.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Unlocking Unified Insights: New Gigamon Federated Search App for Splunk

In today’s data-heavy environment, organizations are caught in a data distribution dilemma. As data volumes ...

GA: New Data Management App in Splunk Platform

Streamlining Data Management: Introducing a unified experience in Splunk Managing data at scale shouldn’t feel ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...