I am planning to use splunk for visualizing my data and could use some help modelling it .
My question is with the fetching the data . What is the best way to fetch this data periodically ? I need to fetch data from mongodb for a particular time frame . Ie this is not real time streaming data .
After I specify data sources using hunk , how do i index the data for specific time ranges ?
Should i create an intermediary application (node.js or java) just for fetching and indexing the data periodically ?
But what are the configuration needed to bring the data into Splunk from mangodb
You can either use the Hunk App for MongoDB or DB Connect with JDBC to MongoDB.
With Hunk App for MongoDB:
in the search use: index=mongoVIX | collect my-local-splunk-index
or
set a schedule search and send the data to my-local-splunk-index
With DB Connect:
Setup Database Input based on rising column or batch. In both cases the data will be sent to a local Splunk index.