Getting Data In

how can I force splunk read file line by line

perlish
Communicator

I have a big file about 17G,when I input it as a file,splunk treat some record as multi-line.
The file is UTF-8 Unicode text.
how can I force splunk read file line by line ?
Thank you very much!

Tags (2)
0 Karma
1 Solution

Takajian
Builder

You need to configure props.conf in order to force splunk index data with single line.
The configuration will be following.

[your_sourcetype]
SHOULD_LINEMERGE = false

You can also refer to the manual as bellow.

http://docs.splunk.com/Documentation/Splunk/5.0/Data/Indexmulti-lineevents

View solution in original post

perlish
Communicator

it works!
Thank you !
the manual are powerful!

0 Karma

Takajian
Builder

You need to configure props.conf in order to force splunk index data with single line.
The configuration will be following.

[your_sourcetype]
SHOULD_LINEMERGE = false

You can also refer to the manual as bellow.

http://docs.splunk.com/Documentation/Splunk/5.0/Data/Indexmulti-lineevents

Get Updates on the Splunk Community!

Improve Your Security Posture

Watch NowImprove Your Security PostureCustomers are at the center of everything we do at Splunk and security ...

Maximize the Value from Microsoft Defender with Splunk

 Watch NowJoin Splunk and Sens Consulting for this Security Edition Tech TalkWho should attend:  Security ...

This Week's Community Digest - Splunk Community Happenings [6.27.22]

Get the latest news and updates from the Splunk Community here! News From Splunk Answers ✍️ Splunk Answers is ...