Getting Data In

Reached end-of-stream while waiting for more data from peer

Damien_Dallimor
Ultra Champion

Every now and again I see this message in a distributed search setup with a few peers and a couple of pooled search heads, using mounted bundles.

Oddly enough, it only ever pops up when executing sub searches.I never see the error when using the Search app , but do see it via all other apps. Weird.

It could be many things, so before I embark on diagnosing it , I thought I'd just ask the audience if anyone else has experienced this and/or remedied it ?

DD.

Tags (1)
0 Karma

Damien_Dallimor
Ultra Champion

Just an update...I disabled mounted bundles and reverted to bundle replication and things are fine now. This was a Splunk 4.2.4 distributed deployment.

Bit of a head scratcher ,I think what was happening was that when using mounted bundles with distributed sub searches, the inner search was using the mounted bundles path , and then the outer search was using the $SPLUNK_HOME/var/run/searchpeers path , which contained no apps because bundle replication wasn't being used.Deduction based on the output of "Inspect Search Job" under the Actions menu. Quite why the inner and outer searches would not both be using the mounted bundles path is a bit weird ??

Never had any problems with regular searches when using mounted bundles, only sub searches.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...