I'm trying to change SMTP server settings under server setting but it doesn't save the changes. I'm logged on as admin.
Sure they're not being set elsewhere? Do you have ssh access to the server? Try running: splunk cmd btool alert_actions list --debug | grep -i mailserver