topic Re: Splunk stream in Splunk Enterprise

Splunk stream

Vadim_Peskov — Mon, 27 Nov 2023 15:20:11 GMT

Hi!
We use Splunk Stream 7.3.0. When receiving an event in a log longer than 1000000 characters, Splunk cuts it. Event in json format. Tell me what settings should be applied in Splunk Stream so that Splunk parses the data correctly.
Thanks!

Re: Splunk stream

_JP — Mon, 27 Nov 2023 17:45:57 GMT

IIRC Splunk Stream doesn't have truncation settings and this ends up being caught by the truncation settings for your sourcetype within props.conf. Can you share what your stanza is for your sourcetype? Is TRUNCATE=1000000? You might need to change to TRUNCATE=0 to force Splunk to include all of the event.

Re: Splunk stream

Vadim_Peskov — Tue, 28 Nov 2023 05:53:29 GMT

now in props.conf
[stream:ip]
TRUNCATE = 100000
I will change to 0, I will check, I will return with the answer

Re: Splunk stream

Vadim_Peskov — Tue, 28 Nov 2023 15:02:33 GMT

[stream:ip] TRUNCATE = 0

did not help.
Any other suggestions?

Re: Splunk stream

_JP — Wed, 29 Nov 2023 20:52:29 GMT

Did you see any change in the data being ingested when you made the TRUNCATE value change? Also, if you change it to something specific to test it, like 10237. Does that limit it to 10237 bytes? This is mainly just to see if this particular TRUNCATE setting is what is limiting your data, and maybe we can help rule it out as the culprit so we know to dig further.