Splunk Search

Strange Splunk Ports

JarrettM
Path Finder

All 37 of my Splunk forwarders establish TLS 1.2 connections to Splunk on port 9997 as configured. No problem there. But splunkd is also listening on 8884 and 6 of the forwarders continually attempt a raw connection to this port in addition to the TLS one they make on 9997. The connections are not established but still I would like to close the port on both sides. The configurations on those 6 are the same as on the other 31 that are that using not using that port. Netstat confirms that it is splunkd that is listening on 8884.

Any ideas why splunkd would be listening on that port, why those 6 forwarders are attempting to connect on it and how to close it on both sides?

Thanks!

Tags (1)
0 Karma
1 Solution

xpac
SplunkTrust
SplunkTrust

Port 8884 isn't any default port used by Splunk in any way. Just to make sure I searched the docs and Google for it, but there is absolutely zero about it (as you might already have noticed).
I'd search through all .conf files on the affected servers for the string "8884" - it must be mentioned anywhere.
Did you, by any chance, install a certain add-on or app that might have opened that port?
You could also do this from the CLI: splunk btool inputs list and check the output for 8884 anywhere.

Besides that, I'm a little out of ideas on this.

View solution in original post

amitm05
Builder

This is a strange port in context to splunk.
However I'd do the following :

  1. Verify my Web and Management ports on all the indexing machines by running the commands - ./splunk show web-port ./splunk show splunkd-port

And also the receiving port.

This will take you one step forward in troubleshooting, either you'd find that these are the default ones i.e. 8000, 8089 and 9997.
OR
one of the services is using 8884 or may be the multiple receiving ports (i.e. 9997 and 8884) have opened.

And if none of the above happens and no service shows 8884 port, I would use the netstats command to find out the PID which is using 8884 and Kill it (Assuming its a bogus process showing up by the name of splunkd). OR as @xpac says - search through all .conf files on the affected servers for the string "8884"

I hope this may take you closer to your solution !

xpac
SplunkTrust
SplunkTrust

Port 8884 isn't any default port used by Splunk in any way. Just to make sure I searched the docs and Google for it, but there is absolutely zero about it (as you might already have noticed).
I'd search through all .conf files on the affected servers for the string "8884" - it must be mentioned anywhere.
Did you, by any chance, install a certain add-on or app that might have opened that port?
You could also do this from the CLI: splunk btool inputs list and check the output for 8884 anywhere.

Besides that, I'm a little out of ideas on this.

JarrettM
Path Finder

Thanks! Ran that CLI and found it. It's an input from a syslog that I forgot to check.

Thanks again!

JarrettM
Path Finder

Windows 2012 R2 Server

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...