Splunk Search

Can Splunk be used to search and index web pages

lwilliams5301
New Member

Would like to index web page contents in Splunk. Is this possible?

0 Karma

LukeMurphey
Champion

Could you clarify a bit more about what you are looking to index? Are you looking to index:

  1. Information extracted from a website (e.g. "extract the value of some element and index that")
  2. The entire page so that I just do a search for items within the page
  3. Information about the page (e.g. "hash the contents of a web-page so that I can detect when it changes")
  4. Web-server information (e.g. "let me know when the page is inaccessible or slow")
  5. Something else?

ppablo
Retired

There's a Website Input add-on available in Splunkbase that might be what you're looking for.
https://splunkbase.splunk.com/app/1818/

I haven't used it myself, but maybe the developer @LukeMurphey can give you more details.

Get Updates on the Splunk Community!

Build Scalable Security While Moving to Cloud - Guide From Clayton Homes

 Clayton Homes faced the increased challenge of strengthening their security posture as they went through ...

Mission Control | Explore the latest release of Splunk Mission Control (2.3)

We’re happy to announce the release of Mission Control 2.3 which includes several new and exciting features ...

Cloud Platform | Migrating your Splunk Cloud deployment to Python 3.7

Python 2.7, the last release of Python 2, reached End of Life back on January 1, 2020. As part of our larger ...