Getting Data In

Line limit for scripted inputs?

rsigle
Explorer

I have a script that outputs between 300 and 800 lines. The output seems to be truncated after 138 lines. Is there a line limit for scripted inputs, and if so, are they configurable?

I have set MAX_EVENTS=1500 and still have an issue.

0 Karma
1 Solution

gkanapathy
Splunk Employee
Splunk Employee

Do you possibly have a custom LINE_BREAKER, and/or SHOULD_LINEMERGE = false set? If so, your script output may be treated as a single "line" in which case it would be truncated after 50,000 characters. You can raise this by setting TRUNCATE = 999999, for example.

Also, if you are running on a LWF, you should make sure that your output buffer doesn't cut off the middle of an event. It's not that likely to happen unless the output is generated slowly enough that the LWF switches in the middle of your event, but it could happen occasionally. I don't think this is your problem if it's consistent.

View solution in original post

gkanapathy
Splunk Employee
Splunk Employee

Do you possibly have a custom LINE_BREAKER, and/or SHOULD_LINEMERGE = false set? If so, your script output may be treated as a single "line" in which case it would be truncated after 50,000 characters. You can raise this by setting TRUNCATE = 999999, for example.

Also, if you are running on a LWF, you should make sure that your output buffer doesn't cut off the middle of an event. It's not that likely to happen unless the output is generated slowly enough that the LWF switches in the middle of your event, but it could happen occasionally. I don't think this is your problem if it's consistent.

rsigle
Explorer

Setting TRUNCATE = 999999 resolved the issue for me. Thanks again.

0 Karma

rsigle
Explorer

Thank you Gerald. I have SHOULD_LINEMERGE=false set in the props.conf. I will increase the the TRUNCATE option and report back with my results.

We are running LWF, so the output buffer could be an issue, however, the data is not generated slowly, so that will be the next thing I look at.

Rick

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Vibe-coding, AI, and Splunkcraft: Highlights from the .conf26 Builder Bar

If you stopped by the Builder Bar at .conf26, thank you! This year, we brought ...

Thanks for the Memories: .conf26 Took Learning to New Heights

Thank you, Splunk Community, for making .conf26 in Denver one for the books. From packed Splunk University ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...