How to prevent results from an input file being excluded after performing a lookup against another input

[ezmo1982]

Hi,

I have the following search:

| inputlookup ldap_assets.csv
| lookup existing_assets dns output ip bunit category city country owner priority
| outputlookup create_empty=false createinapp=true override_if_empty=false merged_assets.csv

The 'ldap_assets.csv' contains a list of assets and their attributes. The search then does a lookup command on 'existing_assets' lookup which contains other asset attributes (a manually created list).  The search then outputs results to a merged_assets.csv. 

The problem im having is that if a record exists in existing_assets, but it doesnt exist in ldap_assets.csv, it is being excluded from results of the outputlookup command. I would like those existing records to still be included in the merged_assets.csv file. So basically I want the two files to merge without any exclusions after the lookup.

Can somebody provide assistance on where on going wrong?

Thanks. 

[ezmo1982]

Thanks. There are some duplicates in there so i added a dedup command and now i have the results i need.

[bowesmana]

@ezmo1982 

Load the two files with two inputlookups, then merge the two data sets using stats values  grouping by the lookup fields.

| inputlookup ldap_assets.csv
| append [
  | inputlookup existing_assets
]
| stats values(*) as * by dns output ip bunit category city country owner priority
| outputlookup create_empty=false createinapp=true override_if_empty=false merged_assets.csv

 should do the trick

[ezmo1982]

Thanks. Seems like the stats command is resulting in zero records. But turns out i dont need it. 

[scelikok · Accepted solution]

Hi @ezmo1982,

Please try below;

| inputlookup ldap_assets.csv 
| append 
    [| inputlookup existing_assets] 
| outputlookup create_empty=false createinapp=true override_if_empty=false merged_assets.csv