All Apps and Add-ons

How to create field extractions for dynamic csv files from headers that change with each file

OMohi
Path Finder

Hi:

How do I create a field based on header on a csv file. The header is different for each file that I am trying to index.

So far I have done the following on props.conf but with no success:

[sourcetype]
SHOULD_LINEMERGE = False
pulldown_type = true
INDEXED_EXTRACTIONS = csv
CHECK_FOR_HEADER = true
KV_MODE = none
category = Structured

Is there something that I am missing.

Please let me know.

Thanks,

Mohammed Mohiuddin

1 Solution

woodcock
Esteemed Legend

You need to put this file on all the forwarders that are sending this data and YES, even though they are NOT Heavy Forwarders. Then restart each Splunk instance on the forwarders.

View solution in original post

woodcock
Esteemed Legend

You need to put this file on all the forwarders that are sending this data and YES, even though they are NOT Heavy Forwarders. Then restart each Splunk instance on the forwarders.

OMohi
Path Finder

Thanks Woodcock,

Your suggestion worked.

0 Karma

MuS
SplunkTrust
SplunkTrust

And here is the reason why it needs to be on the universal forwarder:

When you forward structured data to an indexer, Splunk Enterprise does not parse this data once it arrives at the indexer, even if you have configured props.conf on that indexer with INDEXED_EXTRACTIONS.

http://docs.splunk.com/Documentation/Splunk/6.2.4/Forwarding/Routeandfilterdatad#Caveats_for_routing...

0 Karma
Get Updates on the Splunk Community!

Splunk Observability for AI

Don’t miss out on an exciting Tech Talk on Splunk Observability for AI! Discover how Splunk’s agentic AI ...

[Puzzles] Solve, Learn, Repeat: Dereferencing XML to Fixed-length events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Stay Connected: Your Guide to December Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...