Splunk as a CDC Solution and Reporting BI Tool?

dhineshv — Sat, 18 Nov 2017 19:36:41 GMT

I have a question about using Splunk as a CDC solution (Change Data Capture) from relational transactional database and as a reporting BI tool.

The use case I am looking for is, Splunk acts as a CDC tool fetching change data from a relation database and import Database table data into Splunk. Then perform complex ETL and join operations on the data to create simplified data structure.

Splunk also act as a BI tool to generate reports to end users by performing multilevel joins on the simplified data from the previous step.

Can some one point me to some use cases of Splunk in this area or to any blogs from Splunk users in this area?
Or please suggest your thoughts on if Splunk is the right tool for such scenario?

Thanks in Advance

Re: Splunk as a CDC Solution and Reporting BI Tool?

xavierashe — Sun, 19 Nov 2017 02:22:44 GMT

The short answer is, yes. The nice thing about Splunk is that you don't have to worry about schema. The same data can be ETL-ed over and over.

The most experience I have with working with data from relational databases on Splunk is with ServiceNow. I often do multiple joins, unions and appends. Once you start building data models, you can simply much of the complexity.

You asked for some blog posts:
http://capnjosh.com/blog/using-splunk-as-an-etl-tool-for-data-residing-in-a-relational-database/
https://www.splunk.com/blog/2012/04/24/from-etl-to-splunktl.html
https://www.splunk.com/en_us/solutions/solution-areas/business-analytics.html

topic Re: Splunk as a CDC Solution and Reporting BI Tool? in Reporting

Splunk as a CDC Solution and Reporting BI Tool?

Re: Splunk as a CDC Solution and Reporting BI Tool?