topic Re: What is the best way to index snapshot type data in Splunk and correlate it with other data? in Getting Data In

What is the best way to index snapshot type data in Splunk and correlate it with other data?

jlimlogic — Thu, 22 Dec 2016 21:29:00 GMT

Hello,

we have a need to correlate operational data with billing account information. So we are looking to join ops data with account information data from the billing system.

We can automate a nightly CSV export of the accounts from the billing system and have Splunk index it. But obviously, only the latest copy of the data is valid as it's simply an account name, account number (and a few other useful fields).

What is the best way to achieve this? In a way, it's essentially indexing snapshot Account information data in Splunk and joining it with other ops data for a more complete view.

Re: What is the best way to index snapshot type data in Splunk and correlate it with other data?

somesoni2 — Thu, 22 Dec 2016 22:06:59 GMT

How many accounts that you have? Consider using CSV lookup OR kv-store as well to store the latest state of accounts.

Re: What is the best way to index snapshot type data in Splunk and correlate it with other data?

jlimlogic — Thu, 22 Dec 2016 22:16:49 GMT

it's only about 9K accounts. I'll check out CSV store / kv-store - wasn't aware of it.

thanks!

Re: What is the best way to index snapshot type data in Splunk and correlate it with other data?

niketn — Fri, 23 Dec 2016 16:22:16 GMT

You can run outputlookup as daily scheduled command to write to excel as CSV or KV Store to be updated daily after midnight.
Refer to the documentation on outputlookup: http://docs.splunk.com/Documentation/Splunk/latest/SearchReference/Outputlookup