Splunk Search

Can Splunk be used to search and index web pages

lwilliams5301
New Member

Would like to index web page contents in Splunk. Is this possible?

0 Karma

LukeMurphey
Champion

Could you clarify a bit more about what you are looking to index? Are you looking to index:

  1. Information extracted from a website (e.g. "extract the value of some element and index that")
  2. The entire page so that I just do a search for items within the page
  3. Information about the page (e.g. "hash the contents of a web-page so that I can detect when it changes")
  4. Web-server information (e.g. "let me know when the page is inaccessible or slow")
  5. Something else?

ppablo
Retired

There's a Website Input add-on available in Splunkbase that might be what you're looking for.
https://splunkbase.splunk.com/app/1818/

I haven't used it myself, but maybe the developer @LukeMurphey can give you more details.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Dynamic formatting from XML events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...