About sugata

sugata · ‎01-01-2026

Thanks for your reply @livehybrid The add-on that you mentioned is good for querying databricks (sending a command TO databricks) but I am looking for a solution which can send logs FROM databricks. Example - am building a 10 steps ETL pipeline in databricks, which is hosted in aws. At the end of the each step, i need to write a log in splunk aout its success/failure. I have a schema defined for the log. So my question is how to send that event/log into splunk, which is hosted somewhere else and not in aws. I feel splunk might have somekind of API exposed for that. just dont know which API, how to call, how to configure, what are the best practices etc.

sugata · ‎12-29-2025

i have my databricks setup in aws which runs multiple ETL pipelines. i want to send logs, metrices, application flow tracker etc. in splunk. i am not sure on how this can be achieved. i have my organisation splunk setup where i can generate my auth token and can see the endpoint details. whether this is enough to push data from databricks to splunk or i need to have open telemetry alike collector which will read the data stored in databricks /some/location and push them to splunk?

Posts	2
Solutions	0
Karma Given	1
Karma Received	0
Member Since	‎12-29-2025

Online Status	Offline
Date Last Visited	‎01-04-2026 11:07 AM

Integrating Splunk with Databricks

Re: Integrating Splunk with Databricks

Integrating Splunk with Databricks

Join the Conversation

Integrating Splunk with Databricks

Re: Integrating Splunk with Databricks

Integrating Splunk with Databricks