Deployment Architecture

UF parallelization for Splunk Cloud

X_Kinkead
Explorer

I'm looking for advice for avoiding the 'Funnel Effect' for a small number of intermediate Universal Forwarders to about 15 cloud indexers - my best lead is to apply parallelization - has anyone had success with that, specifically to the Cloud version?  Are there alternatives?  

Here is a presentation on that issue, where the problem is described at depth but the parallelization solution is only briefly touched upon:

Video - https://www.splunk.com/en_us/resources/videos/worst-practices-and-how-to-fix-them.html
Presentation - https://conf.splunk.com/files/2017/slides/worst-practicesand-how-to-fix-them.pdf

Thanks for any advice!

Labels (1)
0 Karma

X_Kinkead
Explorer

It turns out that there was a change in corporate policy which allows for each of these systems to access the 'outside' network segment, provided a business need could be given, so I'm good to go - thanks!

0 Karma

richgalloway
SplunkTrust
SplunkTrust

My advice and (IMO) the best way to avoid the Funnel Effect is to eliminate intermediate forwarders.  Usually, they're unnecessary.  UFs should be sending directly to the cloud indexers.  The network team may complain about too many firewall rules, but that's often just laziness.

---
If this reply helps you, Karma would be appreciated.
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Introducing the 2026 - 2027 SplunkTrust cohort!

The goal of the SplunkTrust™ membership has historically been to acknowledge and recognize those who go above ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...