All Apps and Add-ons

MongoDb data indexing

sssid
New Member

I am planning to use splunk for visualizing my data and could use some help modelling it .

  • i have some json data stored in mongodb that i need to access in splunk .
  • Data reaches upto 1 TB per day .
  • I need to fetch, process and index this data so it can be viewed in splunk.

My question is with the fetching the data . What is the best way to fetch this data periodically ? I need to fetch data from mongodb for a particular time frame . Ie this is not real time streaming data .

After I specify data sources using hunk , how do i index the data for specific time ranges ?

Should i create an intermediary application (node.js or java) just for fetching and indexing the data periodically ?

0 Karma

puneethgowda
Communicator

But what are the configuration needed to bring the data into Splunk from mangodb

0 Karma

rdagan_splunk
Splunk Employee
Splunk Employee

You can either use the Hunk App for MongoDB or DB Connect with JDBC to MongoDB.
With Hunk App for MongoDB:
in the search use: index=mongoVIX | collect my-local-splunk-index
or
set a schedule search and send the data to my-local-splunk-index

With DB Connect:
Setup Database Input based on rising column or batch. In both cases the data will be sent to a local Splunk index.

0 Karma
Get Updates on the Splunk Community!

Splunk AI Assistant for SPL | Key Use Cases to Unlock the Power of SPL

Splunk AI Assistant for SPL | Key Use Cases to Unlock the Power of SPL  The Splunk AI Assistant for SPL ...

Buttercup Games: Further Dashboarding Techniques (Part 5)

This series of blogs assumes you have already completed the Splunk Enterprise Search Tutorial as it uses the ...

Customers Increasingly Choose Splunk for Observability

For the second year in a row, Splunk was recognized as a Leader in the 2024 Gartner® Magic Quadrant™ for ...