Hi All, We have a saved search (snippet below) which populates a CSV lookup file. The search is scheduled to run daily. index=xyz
...
| stats latest(_time) as _time, latest(legacyUsername), latest(title), latest(email), latest(endDate), latest(firstname), latest(lastname), by identity
| rename latest(*) as *
| eval identity = identity+"|"+email+"|"+legacyUsername What's happening is, every time the search runs it creates duplicates as in each subsequent row appends the results from the previous row to it for the "Identity" column as shown below. I get that my "eval identity" command is making it do it. But how can i make it not create new records if the "identity" already exists once in the table? Hope i am clear. I tried "Dedup identity" that didn't work. Result: Identity time legacyuserName title email enddata first lastname 1001|
[email protected]|karen_woo xx xxxx xxx xxx xx Karen Woo 1001|
[email protected]|karen_woo |
[email protected]|karen_woo xx xxxx xxx xxx xx Karen Woo 1001|
[email protected]|karen_woo |
[email protected]|karen_woo |
[email protected]|karen_woo xx xxxx xxx xxx xx Karen Woo 1001|
[email protected]|karen_woo|
[email protected]|karen_woo |
[email protected]|karen_woo|
[email protected]|karen_woo |
[email protected]|karen_woo xx Karen Woo
... View more