topic How to prevent results from an input file being excluded after performing a lookup against another input in Splunk Search

How to prevent results from an input file being excluded after performing a lookup against another input

ezmo1982 — Thu, 04 Feb 2021 17:45:54 GMT

Hi,

I have the following search:

| inputlookup ldap_assets.csv
| lookup existing_assets dns output ip bunit category city country owner priority
| outputlookup create_empty=false createinapp=true override_if_empty=false merged_assets.csv

The 'ldap_assets.csv' contains a list of assets and their attributes. The search then does a lookup command on 'existing_assets' lookup which contains other asset attributes (a manually created list). The search then outputs results to a merged_assets.csv.

The problem im having is that if a record exists in existing_assets, but it doesnt exist in ldap_assets.csv, it is being excluded from results of the outputlookup command. I would like those existing records to still be included in the merged_assets.csv file. So basically I want the two files to merge without any exclusions after the lookup.

Can somebody provide assistance on where on going wrong?

Thanks.

Re: How to prevent results from an input file being excluded after performing a lookup against another input

scelikok — Thu, 04 Feb 2021 19:42:41 GMT

Hi @ezmo1982,

Please try below;

| inputlookup ldap_assets.csv | append [| inputlookup existing_assets] | outputlookup create_empty=false createinapp=true override_if_empty=false merged_assets.csv

Re: How to prevent results from an input file being excluded after performing a lookup against another input

bowesmana — Fri, 05 Feb 2021 02:20:02 GMT

@ezmo1982

Load the two files with two inputlookups, then merge the two data sets using stats values grouping by the lookup fields.

| inputlookup ldap_assets.csv | append [ | inputlookup existing_assets ] | stats values(*) as * by dns output ip bunit category city country owner priority | outputlookup create_empty=false createinapp=true override_if_empty=false merged_assets.csv

should do the trick

Re: How to prevent results from an input file being excluded after performing a lookup against another input

ezmo1982 — Fri, 05 Feb 2021 16:16:22 GMT

Thanks. Seems like the stats command is resulting in zero records. But turns out i dont need it.

Re: How to prevent results from an input file being excluded after performing a lookup against another input

ezmo1982 — Fri, 05 Feb 2021 16:17:19 GMT

Thanks. There are some duplicates in there so i added a dedup command and now i have the results i need.