Getting Data In

how can I force splunk read file line by line

perlish
Communicator

I have a big file about 17G,when I input it as a file,splunk treat some record as multi-line.
The file is UTF-8 Unicode text.
how can I force splunk read file line by line ?
Thank you very much!

Tags (2)
0 Karma
1 Solution

Takajian
Builder

You need to configure props.conf in order to force splunk index data with single line.
The configuration will be following.

[your_sourcetype]
SHOULD_LINEMERGE = false

You can also refer to the manual as bellow.

http://docs.splunk.com/Documentation/Splunk/5.0/Data/Indexmulti-lineevents

View solution in original post

perlish
Communicator

it works!
Thank you !
the manual are powerful!

0 Karma

Takajian
Builder

You need to configure props.conf in order to force splunk index data with single line.
The configuration will be following.

[your_sourcetype]
SHOULD_LINEMERGE = false

You can also refer to the manual as bellow.

http://docs.splunk.com/Documentation/Splunk/5.0/Data/Indexmulti-lineevents

Get Updates on the Splunk Community!

Splunk Observability as Code: From Zero to Dashboard

For the details on what Self-Service Observability and Observability as Code is, we have some awesome content ...

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Shape the Future of Splunk: Join the Product Research Lab!

Join the Splunk Product Research Lab and connect with us in the Slack channel #product-research-lab to get ...