What is the best way to index snapshot type data in Splunk and correlate it with other data?

[jlimlogic]

Hello,

we have a need to correlate operational data with billing account information. So we are looking to join ops data with account information data from the billing system.

We can automate a nightly CSV export of the accounts from the billing system and have Splunk index it. But obviously, only the latest copy of the data is valid as it's simply an account name, account number (and a few other useful fields).

What is the best way to achieve this? In a way, it's essentially indexing snapshot Account information data in Splunk and joining it with other ops data for a more complete view.

[niketn]

You can run outputlookup as daily scheduled command to write to excel as CSV or KV Store to be updated daily after midnight.
Refer to the documentation on outputlookup: http://docs.splunk.com/Documentation/Splunk/latest/SearchReference/Outputlookup

[somesoni2]

How many accounts that you have? Consider using CSV lookup OR kv-store as well to store the latest state of accounts.

[jlimlogic]

it's only about 9K accounts. I'll check out CSV store / kv-store - wasn't aware of it.

thanks!