My guess is the input was defined (by mistake) in an inputs.conf in a default folder. Run the following command from your CLI:
splunk cmd btool inputs list --debug | grep tcp://1514
This should show you where exactly the input is configured. Go there to delete it. If it is in the default folder of an app (or worse, system), this was the reason you couldn't remove it via the UI.