Getting Data In

Database to file

harshavrath
Contributor

Hi,

Is there a way to extract data from an database on regular intervals & save it in an file which can be supplied to Splunk as input.

I don't want to use Splunk Db Connect initially my boss wants to try the manual way.

I got to know Scripts can be used for this purpose.

I need some specific information on how it can be done.

Any help is appreciated.

Cheers.

Tags (1)
0 Karma
1 Solution

lpolo
Motivator

Approach 1:

1) Create a script in python that will connect to your database and get the results you need to from your database.
2) Configure a data input script in splunk to schedule your script to run in the intervals you need. In the configuration of this data input, you specify the index where the results will stored in splunk for future retrieval and along with its source type.

Approach 2:

1) Install SplunkDB in your splunk instance.
2) Configure the DB connection to access the database you need.
3) Create a scheduled search for the intervals you need. The schedule search contains the SQL query that will retrieve the information you need from your database. In the configuration of this scheduled search, you specify the index where the results will stored in splunk for future retrieval and along with its source type.

View solution in original post

lpolo
Motivator

Approach 1:

1) Create a script in python that will connect to your database and get the results you need to from your database.
2) Configure a data input script in splunk to schedule your script to run in the intervals you need. In the configuration of this data input, you specify the index where the results will stored in splunk for future retrieval and along with its source type.

Approach 2:

1) Install SplunkDB in your splunk instance.
2) Configure the DB connection to access the database you need.
3) Create a scheduled search for the intervals you need. The schedule search contains the SQL query that will retrieve the information you need from your database. In the configuration of this scheduled search, you specify the index where the results will stored in splunk for future retrieval and along with its source type.

lpolo
Motivator
0 Karma

harshavrath
Contributor

Hi Ipolo,
can you give any specifics as how to create a script any source that i can refer to.

0 Karma

harshavrath
Contributor

Oracle SQL Developer

0 Karma

aelliott
Motivator

What kind of database is it?

0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...