BMC Remedy add on in a search head cluster

[ialahdal]

I am having trouble using the BMC Remedy Add on in a search head cluster environment.

First issue I am running into is that the web ui does not go beyond "Loading" on any of the members, worked around this by creating a "splunk_ta_remedy_settings.conf" in CLI with the settings there.

Second issue I am recieving is command="remedyincidentcreate", cannot concatenate 'str' and 'NoneType' objects when running | remedyincidentcreate --help in the search bar.

Any thoughts on how to solve this?

[ialahdal · Accepted solution]

The issue was caused by moving our environment from single node to search head cluster, the passwords.conf was the culprit, removing it from the add ons that used it solved the issue.

[tzvifriedman]

I've been searching for days for a solution to this. And to anyone else that comes across this, this is a problem for any add-on, not just the one in question. This worked like a charm. 

As a shortcut to find all your passwords.conf files, you can do 

sudo find /opt/splunk/etc/apps/ -name passwords.conf

and if you want to delete them all, 

sudo find /opt/splunk/etc/apps/ -name passwords.conf | xargs rm

then restart splunk

[ialahdal]

This pops up from inspecting the add-on page that's stuck on loading
{"messages":[{"type":"ERROR","text":"Unexpected error \"\" from python handler: \"REST Error [500]: Internal Server Error -- Traceback (most recent call last):\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/splunktaucclib/rest_handler/handler.py\", line 116, in wrapper\n for name, data, acl in meth(self, *args, **kwargs):\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/splunktaucclib/rest_handler/handler.py\", line 302, in _format_response\n masked = self.rest_credentials.decrypt_for_get(name, data)\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/splunktaucclib/rest_handler/credentials.py\", line 187, in decrypt_for_get\n clear_password = self._get(name)\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/splunktaucclib/rest_handler/credentials.py\", line 392, in _get\n string = mgr.get_password(user=context.username())\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/solnlib/utils.py\", line 159, in wrapper\n return func(*args, **kwargs)\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/solnlib/credentials.py\", line 118, in get_password\n all_passwords = self._get_all_passwords()\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/solnlib/utils.py\", line 159, in wrapper\n return func(*args, **kwargs)\n File \"/opt/splunk/etc/apps/Splunk_TA_remedy/bin/splunk_ta_remedy/solnlib/credentials.py\", line 272, in _get_all_passwords\n clear_password += field_clear[index]\nTypeError: cannot concatenate 'str' and 'NoneType' objects\n\". See splunkd.log for more details."}]}