Getting Data In

Could I send uncooked data to a splunk indexer?

sonicant
Path Finder

In the document I found:
With raw data, ...... This is particularly useful for sending data to a non-Splunk system.

In my case, the server which forwarder was installed has heavy load, and all the log files are zipped.
So the forwarder has to decompress the packages then read the log files and send data to indexer, this consumes extra CPU time, and leads to slow data forwarding.

So I wonder is there a way to tell the forwarder don't decompress the ZIP packages, just send them to indexer and let indexers do the unzip job?

I tried adding "sendCookedData=false" to inputs.conf and restarted the forwarder, but then the indexer refused the connection from the forwarder....

Thanks for anyone may help!

Tags (1)
0 Karma
1 Solution

Ayn
Legend

No, regardless of whether the data would be cooked or not, you can't send data from zip files straight away like that. That data is cooked just means (somewhat simplified) that certain metadata is added to the data stream instead of just sending the raw data. It doesn't affect how the events are read from the sources initially.

View solution in original post

Ayn
Legend

No, regardless of whether the data would be cooked or not, you can't send data from zip files straight away like that. That data is cooked just means (somewhat simplified) that certain metadata is added to the data stream instead of just sending the raw data. It doesn't affect how the events are read from the sources initially.

Ayn
Legend

That is correct.

0 Karma

sonicant
Path Finder

Hi Ayn

Thank you! So there is no way to let forwarder send original zip files to indexer. (Unless using self-made scripts to do the file transferring) Is my understanding right?
And the sendCookedData=false option should only be used when sending data to non-Splunk listener, right?

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Are you leveraging automation to its fullest potential in your threat detection strategy?Our upcoming Security ...

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...