Getting Data In

Reached end-of-stream while waiting for more data from peer

Damien_Dallimor
Ultra Champion

Every now and again I see this message in a distributed search setup with a few peers and a couple of pooled search heads, using mounted bundles.

Oddly enough, it only ever pops up when executing sub searches.I never see the error when using the Search app , but do see it via all other apps. Weird.

It could be many things, so before I embark on diagnosing it , I thought I'd just ask the audience if anyone else has experienced this and/or remedied it ?

DD.

Tags (1)
0 Karma

Damien_Dallimor
Ultra Champion

Just an update...I disabled mounted bundles and reverted to bundle replication and things are fine now. This was a Splunk 4.2.4 distributed deployment.

Bit of a head scratcher ,I think what was happening was that when using mounted bundles with distributed sub searches, the inner search was using the mounted bundles path , and then the outer search was using the $SPLUNK_HOME/var/run/searchpeers path , which contained no apps because bundle replication wasn't being used.Deduction based on the output of "Inspect Search Job" under the Actions menu. Quite why the inner and outer searches would not both be using the mounted bundles path is a bit weird ??

Never had any problems with regular searches when using mounted bundles, only sub searches.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Meet Splunk Observability Studio: AI-Assisted OpenTelemetry Instrumentation Without ...

Instrumentation is usually the last step or even an afterthought when building out a project. The feature ...

Federated Search for Cisco Security and Analytics Logging (SAL) is now GA on Splunk ...

Federated Search for Cisco  Security Analytics and Logging (SAL) is now generally available as part of the ...

Your Path to AgenticOps: AI Experiences for Every Splunk Practitioner

Your Path to AgenticOps: AI Experiences for Every Splunk Practitioner   Join us for a demo-driven look at how ...