Getting Data In

What is the identification process for SplunkForwarder?

agentsofshield
Path Finder

I've been asked to write a document about the process of SplunkForwarder connecting with a deployer or indexer and forwarding data.

I've been browsing Splunk docs for an hour or two and all I see is configuration / troubleshooting tutorials.

What is the identification process step by step?

I'm guessing it's something like: heartbeat > enlistment > application push > data push, but I'm not sure myself and I hope you guys have a better, more detailed explanation for me.

0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

The forwarder communicates with a few Splunk processes, not necessarily in this order.

  1. If configured as a deployment client, it contacts its Deployment Server and requests a list of apps to download. It downloads those apps and restarts itself as necessary.
  2. If Indexer Discovery is enabled, it contacts the Master Node to get a list of indexers. Otherwise, it gets the indexer list from its own outputs.conf file.
  3. It opens the first indexer in its list and starts sending data. If that indexer is not available, the forwarder will try the others on its list.
  4. Periodically, the forwarder will close the connection to its indexer and open a new connection to another indexer. When it does this is controlled by several settings.

As for the protocol between the forwarder and the other processes, well, its proprietary so you're not likely to find documentation on it. Wireshark may be your best friend for help with that.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

The forwarder communicates with a few Splunk processes, not necessarily in this order.

  1. If configured as a deployment client, it contacts its Deployment Server and requests a list of apps to download. It downloads those apps and restarts itself as necessary.
  2. If Indexer Discovery is enabled, it contacts the Master Node to get a list of indexers. Otherwise, it gets the indexer list from its own outputs.conf file.
  3. It opens the first indexer in its list and starts sending data. If that indexer is not available, the forwarder will try the others on its list.
  4. Periodically, the forwarder will close the connection to its indexer and open a new connection to another indexer. When it does this is controlled by several settings.

As for the protocol between the forwarder and the other processes, well, its proprietary so you're not likely to find documentation on it. Wireshark may be your best friend for help with that.

---
If this reply helps you, Karma would be appreciated.

agentsofshield
Path Finder

Thanks for the thorough explanation.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Laser Bananas and Edge Hubs: Exploring Operational Technology (OT) Data Through a ...

  OT is a different environment to traditional IT and can have interesting challenges when interfacing the ...

Event Series: Mastering AI Tokenomics and Splunk Agent Observability

Beyond the Black Box: Correlating AI Performance and Tokenomics with Splunk Agent Observability   As ...

span_metrics: The OpenTelemetry-Idiomatic Way to See Inside Your Services

You open a trace in Splunk Observability Cloud and everything looks fine. One root span, order-pipeline, with ...