topic Re: Database to file in Getting Data In

Database to file

harshavrath — Fri, 14 Mar 2014 13:12:58 GMT

Hi,

Is there a way to extract data from an database on regular intervals & save it in an file which can be supplied to Splunk as input.

I don't want to use Splunk Db Connect initially my boss wants to try the manual way.

I got to know Scripts can be used for this purpose.

I need some specific information on how it can be done.

Any help is appreciated.

Cheers.

Re: Database to file

aelliott — Fri, 14 Mar 2014 13:24:30 GMT

What kind of database is it?

Re: Database to file

harshavrath — Fri, 14 Mar 2014 13:26:29 GMT

Oracle SQL Developer

Re: Database to file

lpolo — Fri, 14 Mar 2014 13:33:50 GMT

Approach 1:

1) Create a script in python that will connect to your database and get the results you need to from your database.
2) Configure a data input script in splunk to schedule your script to run in the intervals you need. In the configuration of this data input, you specify the index where the results will stored in splunk for future retrieval and along with its source type.

Approach 2:

1) Install SplunkDB in your splunk instance.
2) Configure the DB connection to access the database you need.
3) Create a scheduled search for the intervals you need. The schedule search contains the SQL query that will retrieve the information you need from your database. In the configuration of this scheduled search, you specify the index where the results will stored in splunk for future retrieval and along with its source type.

Re: Database to file

harshavrath — Fri, 14 Mar 2014 14:11:44 GMT

Hi Ipolo,
can you give any specifics as how to create a script any source that i can refer to.

Re: Database to file

lpolo — Fri, 14 Mar 2014 14:31:56 GMT

This might be a start point:
http://docs.splunk.com/Documentation/Splunk/latest/Data/Setupcustominputs#Add_a_scripted_input_via_inputs.conf