topic Hunk Line Break Configuration in Getting Data In

Hunk Line Break Configuration

Matthias_BY — Fri, 08 Nov 2013 09:25:46 GMT

Hello,

as i did understand within Hunk data is returned in Jason format. I have log data in my Hadoop Environment. Connection + Search is working fine.

But the line break does not work properly. In one "Hunk" Event are always 4 of my Events. Even the events have quite similar structure...

how can i configure the event break settings within Hunk? couldn't find anything in the documentation.

Thanks a lot
Matthias

Re: Hunk Line Break Configuration

bwooden — Fri, 08 Nov 2013 13:26:00 GMT

When a report-generating search is initiated, Hunk uses the Hadoop MapReduce framework to process the data in place. All of the parsing of data, including source typing, event breaking, and time stamping that is normally done at index time is performed in Hadoop at search time.

source: HUNK Docs

So you can use props and transforms as you normally would -- they're just executed at search time vs. index time for HUNK.

Re: Hunk Line Break Configuration

Matthias_BY — Tue, 12 Nov 2013 07:52:37 GMT

Thanks a lot. the trick was to edit the props.conf and reference the sourcetype with the file path in the stanca.

http://docs.splunk.com/Documentation/Hunk/latest/Hunk/Setupavirtualindex#Edit_props.conf_.28optional.29_to_define_data_processing