Getting Data In

using forwarder and scripts together

ajitshukla
Explorer

We have binary data in .dat file and we have converted it to csv format by running scripts on forwarder and have send csv data to splunk instance. But now the requirement is that we should not run scripts on forwarder.
IS there any way to send binary data to splunk through forwarder and then use scripts ( on splunk side)to parse it to csv format ????

0 Karma

somesoni2
Revered Legend
0 Karma

lakshman239
Influencer

Splunk (indexer) can process binay file, if you don't want to pre-process in forwarder. But, generally pre-processing and sending ascii/text is the preferred way.

Can you load the binary file on to a splunk dev instance [ via Data inputs] and see if it can parse and extract fields? If it does and matches your requirement, you can use the generated props.conf and use it in your instance. Also look at the following https://www.splunk.com/blog/2011/07/19/the-naughty-bits-how-to-splunk-binary-logfiles.html

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Fuel Your Journey: What’s Waiting for You at the .conf26 Acceleration Station

Navigating the show floor at .conf26 isn't just about keynotes and technical breakout sessions; it's also ...

Join the Final Session of the Data Management & Federation Bootcamp Series

Over the past three sessions of the Data Management & Federation Bootcamp Series, we've explored how to build ...

From Data to Insight: Announcing the Winners of the Splunk Dashboard Contest

Hi Splunkers, First off, thank you to everyone who participated in our very first From Data to Insight: The ...