Getting Data In

The header order changes in my monitored CSV file. Is there a way to have the forwarded data follow this order dynamically?

riotto
Path Finder

I am monitoring a file that has comma separated values. For example: John, Smith, Maine

The data is being forwarded by a Universal Forwarder. I have the props.conf and transforms.conf set up to receive the data as: firstname, lastname, state

When I search in Splunk -- firstname=John, lastname=Smith, state=Maine

Here's the problem, the order of the data can change in the file, so my fields contain the wrong type of data. Is there a way to
to have the data follow its order dynamically? There is a header that is sent that tells me when the order changes.

0 Karma

dmaislin_splunk
Splunk Employee
Splunk Employee

Check out indexed_extractions and leverage these new options to extract the structured data fields. NOTE: The indexed_extractions = CSV settings from props.conf are used on the FORWARDER. This method will always ensure that the fields are extracted correctly every time based on the header in the file.

http://docs.splunk.com/Documentation/Splunk/6.5.0/Data/Extractfieldsfromfileswithstructureddata

0 Karma

riotto
Path Finder

doesn't the indexed_extractions do indexed time extraction, which I see in lots of documentation to avoid?

0 Karma
Get Updates on the Splunk Community!

Buttercup Games: Further Dashboarding Techniques (Part 6)

This series of blogs assumes you have already completed the Splunk Enterprise Search Tutorial as it uses the ...

Technical Workshop Series: Splunk Data Management and SPL2 | Register here!

Hey, Splunk Community! Ready to take your data management skills to the next level? Join us for a 3-part ...

Splunk Observability Synthetic Monitoring - Resolved Incident on Detector Alerts

We’ve discovered a bug that affected the auto-clear of Synthetic Detectors in the Splunk Synthetic Monitoring ...