I've been trying to look for a way to for Splunk to input real-time data. Can Splunk do an http get request to a site every 15 minutes or so to get data from html page? For testing purposes, we could use google.com be the page that i want to grab the information from, and I want to set up Splunk to grab whatever in that html page and input it into the data. Is this possible? If yes, any ideas how I could do this?
This app : https://splunkbase.splunk.com/app/1546/
And set the polling interval to 15.
You might also want to plug in a custom response handler so you only index the parts of the http response data that you are interested in.
Hi Damien, Thanks for your response. I was able to set that interval to 15 min but for some reason it doesn't pull data in. I do a search with the specified index that I set it to but it showed 0 event. Did I do something wrong here?
Hey @tamduong16, if @damien solved your problem, please don't forget to accept an answer! You can upvote posts as well. (Karma points will be awarded for either action.) Happy Splunking!