Getting Data In

Why does pretty-print JSON events get truncated?

yuanliu
SplunkTrust
SplunkTrust

I have some events that exceeds the default 10000-byte TRUNCATE limit.  This triggers "truncating line because limit of 10000 bytes has been exceeded."  In Splunk documentation, this is characterized as "line-breaking issues".

Because the events are received in JSON, I thought reducing line length would solve this problem without tweaking TRUNCATE.  But this doesn't.  After pretty-print, large JSON documents still get truncated.

Does this mean that the "line breaking issue" is really "event breaking issue", that the indexer requires every event to be under TRUNCATE limit?  The JSON documents have the correct syntax including the opening and closing brackets.

Labels (3)
Tags (1)
0 Karma

scelikok
SplunkTrust
SplunkTrust

TRUNCATE applies to all events. You should set this value high enough for each sourcetype that exceeds the default 10000 limit. 

If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma

yuanliu
SplunkTrust
SplunkTrust

So, is it correct to say that TRUNCATE applies to total length of an event message, not about an exceedingly long line in a message?  Specific to structured message types like JSON and CSV, each document/row must be within TRUNCATE limit, no matter whether and where newline is placed.

0 Karma
Get Updates on the Splunk Community!

What the End of Support for Splunk Add-on Builder Means for You

Hello Splunk Community! We want to share an important update regarding the future of the Splunk Add-on Builder ...

Solve, Learn, Repeat: New Puzzle Channel Now Live

Welcome to the Splunk Puzzle PlaygroundIf you are anything like me, you love to solve problems, and what ...

Building Reliable Asset and Identity Frameworks in Splunk ES

 Accurate asset and identity resolution is the backbone of security operations. Without it, alerts are ...