Getting Data In

HTTPS authenticated input source

vijayansundarar
New Member

I have some data that I can access from Web Browser (via authenticated HTTPS). The data is plain text. I would like to use this data as an input source form my Splunk server.

Is there an app that can do this? Is there a way to accomplish this?

Tags (2)
0 Karma
1 Solution

Damien_Dallimor
Ultra Champion

Although it is not REST per say , it is most likely HTTP(s) Get , you should be able to leverage my REST API Modular Input to poll this data for you.

This modular input also supports all standard authentication schemes.

View solution in original post

0 Karma

MuS
Legend

Hi vijayansundararajan,

have you tried the App Web Page Monitor? Within it you can choose whether it will index the page content or not. It supports basic authentication as well as HTTPS.

Otherwise you can write a Python script which will grab the Webpage and do what ever you want with it within Splunk.

hope this helps...

cheers, MuS

0 Karma

MuS
Legend

take a look at the script used by this App, it is a simple Python script using the urllib2 module. For Docs about urllib2 module goto http://docs.python.org/2/library/urllib2.html

0 Karma

vijayansundarar
New Member

Is there any documentation/instructions for the basic authentication?

0 Karma

Damien_Dallimor
Ultra Champion

Although it is not REST per say , it is most likely HTTP(s) Get , you should be able to leverage my REST API Modular Input to poll this data for you.

This modular input also supports all standard authentication schemes.

0 Karma

Damien_Dallimor
Ultra Champion

Modular Inputs were not available in the product until version 5.

0 Karma

vijayansundarar
New Member

Have you had any luck with this on Splunk 4.3.2?

0 Karma

lukejadamec
Super Champion

If you cannot access the server that holds the data and install/configure a forwarder on it with ssl certificates, then your best bet would be to go to the site, down load the data from the site with the secure https connection and save it to a computer that does have a forwarder.

Verify the data is indexable (csv, key=value, etc...) and then monitor that directory/file.

0 Karma

vijayansundarar
New Member

I should have mentioned, that I this is actually a log file and it is continuous. Will this still work? Do I need to provide the difference or can Splunk handle this like it does a file that is forwarded?

0 Karma

ddarmand
Communicator

you can monitore a file in Manager > Data inputs

0 Karma

vijayansundarar
New Member

Do you mean this will work via https with authentication? I do not have access to the filesystem on the remote machine.

0 Karma
Get Updates on the Splunk Community!

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...

New in Observability Cloud - Explicit Bucket Histograms

Splunk introduces native support for histograms as a metric data type within Observability Cloud with Explicit ...