Getting Data In

Why does pretty-print JSON events get truncated?

yuanliu
SplunkTrust
SplunkTrust

I have some events that exceeds the default 10000-byte TRUNCATE limit.  This triggers "truncating line because limit of 10000 bytes has been exceeded."  In Splunk documentation, this is characterized as "line-breaking issues".

Because the events are received in JSON, I thought reducing line length would solve this problem without tweaking TRUNCATE.  But this doesn't.  After pretty-print, large JSON documents still get truncated.

Does this mean that the "line breaking issue" is really "event breaking issue", that the indexer requires every event to be under TRUNCATE limit?  The JSON documents have the correct syntax including the opening and closing brackets.

Labels (3)
Tags (1)
0 Karma

scelikok
SplunkTrust
SplunkTrust

TRUNCATE applies to all events. You should set this value high enough for each sourcetype that exceeds the default 10000 limit. 

If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma

yuanliu
SplunkTrust
SplunkTrust

So, is it correct to say that TRUNCATE applies to total length of an event message, not about an exceedingly long line in a message?  Specific to structured message types like JSON and CSV, each document/row must be within TRUNCATE limit, no matter whether and where newline is placed.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Persistent Queue at TcpOut — One of Splunk's Most Practical Features

Splunk introduced persistent queueing at the tcpout layer as one of the most practical resilience features in ...

Skip the Awkward Silence: Have a .conf-ersation at .conf26

Picture this. You arrive at .conf26 already having your socializing and networking plans mapped out. No ...

Rethinking Zero Trust: From Product Purchases to Logical Control Evidence

Implementing Zero Trust (ZT) across complex environments often falters at the very beginning due to a ...