Reporting

Splunk as a CDC Solution and Reporting BI Tool?

dhineshv
Engager

I have a question about using Splunk as a CDC solution (Change Data Capture) from relational transactional database and as a reporting BI tool.

The use case I am looking for is, Splunk acts as a CDC tool fetching change data from a relation database and import Database table data into Splunk. Then perform complex ETL and join operations on the data to create simplified data structure.

Splunk also act as a BI tool to generate reports to end users by performing multilevel joins on the simplified data from the previous step.

Can some one point me to some use cases of Splunk in this area or to any blogs from Splunk users in this area?
Or please suggest your thoughts on if Splunk is the right tool for such scenario?

Thanks in Advance

Tags (1)
0 Karma
1 Solution

xavierashe
Contributor

The short answer is, yes. The nice thing about Splunk is that you don't have to worry about schema. The same data can be ETL-ed over and over.

The most experience I have with working with data from relational databases on Splunk is with ServiceNow. I often do multiple joins, unions and appends. Once you start building data models, you can simply much of the complexity.

You asked for some blog posts:
http://capnjosh.com/blog/using-splunk-as-an-etl-tool-for-data-residing-in-a-relational-database/
https://www.splunk.com/blog/2012/04/24/from-etl-to-splunktl.html
https://www.splunk.com/en_us/solutions/solution-areas/business-analytics.html

View solution in original post

xavierashe
Contributor

The short answer is, yes. The nice thing about Splunk is that you don't have to worry about schema. The same data can be ETL-ed over and over.

The most experience I have with working with data from relational databases on Splunk is with ServiceNow. I often do multiple joins, unions and appends. Once you start building data models, you can simply much of the complexity.

You asked for some blog posts:
http://capnjosh.com/blog/using-splunk-as-an-etl-tool-for-data-residing-in-a-relational-database/
https://www.splunk.com/blog/2012/04/24/from-etl-to-splunktl.html
https://www.splunk.com/en_us/solutions/solution-areas/business-analytics.html

Get Updates on the Splunk Community!

Splunk at Cisco Live 2025: Learning, Innovation, and a Little Bit of Mr. Brightside

Pack your bags (and maybe your dancing shoes)—Cisco Live is heading to San Diego, June 8–12, 2025, and Splunk ...

Splunk App Dev Community Updates – What’s New and What’s Next

Welcome to your go-to roundup of everything happening in the Splunk App Dev Community! Whether you're building ...

The Latest Cisco Integrations With Splunk Platform!

Join us for an exciting tech talk where we’ll explore the latest integrations in Cisco + Splunk! We’ve ...