Run this search:
index=_internal sourcetype=splunk_python
You are looking for errors like this:
ERROR sendemail:417 - [Errno 111] Connection refused while sending mail to: woodcock@splunxter.com host = YourSearchHead source = /opt/splunk/var/log/splunk/python.log sourcetype = splunk_python
ERROR sendemail:131 - Sending email. subject="Splunk Alert: AntiHack: Block IPs with 10 auth failures in 5 minutes", results_link="http://YourSearchHead.com:8000/app/AntiHack/@go?sid=scheduler__nobody__AntiHack__RMD5e3bf059b79d736d6_at_1485189540_73", recipients="[u'woodcock@splunxter.com']", server="localhost" host = YourSearchHead source = /opt/splunk/var/log/splunk/python.log sourcetype = splunk_python
This tells you that your email settings are bad.
Have you configured Settings -> Server settings -> Email settings ?
... View more