Palo Alto Networks App/Add-on for Splunk: "Could not find all of the specified destination fields in the lookup table."

[kmanson]

Running Splunk 6.3.1 and Palo Alto app 5.0. Receiving the error below when doing a simple search. index=pan_logs
Palo Alto Networks App for Splunk v 5.0 is deployed to search head.
Palo Alto Networks Add-on for Splunk v 3.5 is deployed to search head, indexers, and heavy forwarders.

The limit has been reached for log messages in info.csv. 3 messages have not been written to info.csv. Please refer to search.log for these messages or limits.conf to configure this limit.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'pan:config' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'pan:newapps' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'pan:system' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'pan:threat' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'pan:traffic' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'pan:wildfire_report' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'source::tcp:6000|host::192.168.0.0|pan:threat' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'source::tcp:6000|host::192.168.0.0|pan:traffic' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'source::tcp:6000|host::192.168.0.0|pan:system' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'source::tcp:6000|host::192.168.0.0|pan:threat' and lookup table 'pan_vendor_info_lookup'.
[idx1.servername] Error 'Could not find all of the specified destination fields in the lookup table.' for conf 'source::tcp:6000|host::192.168.0.0|pan:traffic' and lookup table 'pan_vendor_info_lookup'.

[btorresgil · Accepted solution]

This is almost always caused because when upgrading to version 5.0 of the app, you haven't removed the old lookup tables in the app. Unfortunately, Splunk does not remove lookup tables during upgrades, but the lookup tables have been moved from the App to the Add-on, so they need to be removed from the App.

The 5.0 upgrade guide offers more detail on how to remove the lookup tables to correct this issue:
http://pansplunk.readthedocs.org/en/latest/upgrade.html

[duffeysplunk]

This turned out to be my problem but the error message was misleading because it seemed to indicate the problem was on the Indexers where I had already cleared out the extra lookup files, but it was actually an issue on my search head.

[btorresgil]

Glad you were able to resolve the issue!

[vsingla1]

Thanks. this worked for me too like a charm.