Getting Data In

Why does pretty-print JSON events get truncated?

yuanliu
SplunkTrust
SplunkTrust

I have some events that exceeds the default 10000-byte TRUNCATE limit.  This triggers "truncating line because limit of 10000 bytes has been exceeded."  In Splunk documentation, this is characterized as "line-breaking issues".

Because the events are received in JSON, I thought reducing line length would solve this problem without tweaking TRUNCATE.  But this doesn't.  After pretty-print, large JSON documents still get truncated.

Does this mean that the "line breaking issue" is really "event breaking issue", that the indexer requires every event to be under TRUNCATE limit?  The JSON documents have the correct syntax including the opening and closing brackets.

Labels (3)
Tags (1)
0 Karma

scelikok
SplunkTrust
SplunkTrust

TRUNCATE applies to all events. You should set this value high enough for each sourcetype that exceeds the default 10000 limit. 

If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma

yuanliu
SplunkTrust
SplunkTrust

So, is it correct to say that TRUNCATE applies to total length of an event message, not about an exceedingly long line in a message?  Specific to structured message types like JSON and CSV, each document/row must be within TRUNCATE limit, no matter whether and where newline is placed.

0 Karma
Get Updates on the Splunk Community!

New Year, New Changes for Splunk Certifications

As we embrace a new year, we’re making a small but important update to the Splunk Certification ...

[Puzzles] Solve, Learn, Repeat: Unmerging HTML Tables

[Puzzles] Solve, Learn, Repeat: Unmerging HTML TablesFor a previous puzzle, I needed some sample data, and ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...