Getting Data In

Apache Spark and Splunk Comparison

kwonx149
Engager

I would like to request some information.

My customer has a big interest in Splunk Enterprise.
The company has been implementing Hadoop-based big data system.
The Hadoop system includes Apahce Spark.

My customer wants to compare Apache Spark and Splunk with following criteria :
- How both are different each other?
- What Splunk can do or can't do compared to Apache Spark?
- What Apache Spark can do or can't do compared to Splunk?
- How Splunk and Apache Spark can co-exist in a big data system?

My customer knows that Splunk and Hortonworks(Hadoop service provider) are in partner relationship.
The customer wants to get the information how they have collaborated.

Thanks for your help.

Tags (3)
0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

To see how Splunk collaborate with Hortonworks please see this link: http://hortonworks.com/partner/splunk/
As you can see from this link: http://hortonworks.com/hdp/ Sparks is a set of APIs and is one part of a set of about 30 Hadoop related projects. That means with Sparks you still need a different system to collect the data, index the data, store the data, analyze the data, visualize the data, and secure the data.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Painting a Clearer Picture: Creating Cross-Domain Visibility with AI Canvas

    Thursday, June 25, 2026  |  11AM PDT / 2PM EDT  Duration: 1 Hour (Includes live Q&A) Register to ...

Analytics Workspace deprecation

As of Splunk Cloud Platform 10.4.2604 and Splunk Enterprise 10.4, Analytics Workspace is now deprecated. ...

Splunk Developer Day Recap: Building, Publishing, and Growing on the Splunk Platform

Splunk Developer Day brought the Splunk developer community together for a practical look at what it means to ...