Getting Data In

Reached end-of-stream while waiting for more data from peer

Damien_Dallimor
Ultra Champion

Every now and again I see this message in a distributed search setup with a few peers and a couple of pooled search heads, using mounted bundles.

Oddly enough, it only ever pops up when executing sub searches.I never see the error when using the Search app , but do see it via all other apps. Weird.

It could be many things, so before I embark on diagnosing it , I thought I'd just ask the audience if anyone else has experienced this and/or remedied it ?

DD.

Tags (1)
0 Karma

Damien_Dallimor
Ultra Champion

Just an update...I disabled mounted bundles and reverted to bundle replication and things are fine now. This was a Splunk 4.2.4 distributed deployment.

Bit of a head scratcher ,I think what was happening was that when using mounted bundles with distributed sub searches, the inner search was using the mounted bundles path , and then the outer search was using the $SPLUNK_HOME/var/run/searchpeers path , which contained no apps because bundle replication wasn't being used.Deduction based on the output of "Inspect Search Job" under the Actions menu. Quite why the inner and outer searches would not both be using the mounted bundles path is a bit weird ??

Never had any problems with regular searches when using mounted bundles, only sub searches.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

ATTENTION: We’re Moving! (AGAIN!)

The Splunk Community Slack is undergoing a system migration to keep our workspace secure and ...

Deep Dive: Optimizing Telemetry Pipelines in Splunk Observability Cloud

In this session, we will peel back the layers of Splunk Observability Cloud’s cost-optimization features. ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...