How to extract data from HTML request to import to Splunk?

[dreadangel]

Hi all,

Due to lack of production API, in order to import data to Splunk there is a need to load an HTML, parse it and upload it to Splunk.

In order to solve this task I consider using the collect function, HTML I'm going to parse as XML.

The problem I'm facing is how to make a request and return the HTML page - the rumors say that python can be used for this purpose, but I have no idea.

Could you provide some start points on the matter?

Thank you in advance.

[dreadangel · Accepted solution]

I'll respond to myself - http://dev.splunk.com/view/custom-spl/SP-CAAAFFT - startpoint to develop custom search commands...