Getting Data In

Reached end-of-stream while waiting for more data from peer

Damien_Dallimor
Ultra Champion

Every now and again I see this message in a distributed search setup with a few peers and a couple of pooled search heads, using mounted bundles.

Oddly enough, it only ever pops up when executing sub searches.I never see the error when using the Search app , but do see it via all other apps. Weird.

It could be many things, so before I embark on diagnosing it , I thought I'd just ask the audience if anyone else has experienced this and/or remedied it ?

DD.

Tags (1)
0 Karma

Damien_Dallimor
Ultra Champion

Just an update...I disabled mounted bundles and reverted to bundle replication and things are fine now. This was a Splunk 4.2.4 distributed deployment.

Bit of a head scratcher ,I think what was happening was that when using mounted bundles with distributed sub searches, the inner search was using the mounted bundles path , and then the outer search was using the $SPLUNK_HOME/var/run/searchpeers path , which contained no apps because bundle replication wasn't being used.Deduction based on the output of "Inspect Search Job" under the Actions menu. Quite why the inner and outer searches would not both be using the mounted bundles path is a bit weird ??

Never had any problems with regular searches when using mounted bundles, only sub searches.

0 Karma
Get Updates on the Splunk Community!

Introducing Splunk Enterprise 9.2

WATCH HERE! Watch this Tech Talk to learn about the latest features and enhancements shipped in the new Splunk ...

Adoption of RUM and APM at Splunk

    Unleash the power of Splunk Observability   Watch Now In this can't miss Tech Talk! The Splunk Growth ...

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...