Getting Data In

How to connect to external lookup using Python script?

nnimbe1
Path Finder

We were using below script to connect and download csv and store it in folder. But now website has changed and it asks for the username and password. Can somebody suggests any required changes where we can connect to URL, Authenticate with username and password, and download the file?

import os

import urllib2

response = urllib2.urlopen('URL')

data = response.read()

filename = os.path.join(os.environ['SPLUNK_HOME'], 'etc', 'apps', 'SPLAPP', 'lookups', "Splunk_Monitored_Hosts.csv")

file_ = open(filename, 'w')

file_.write(data)
#file_.close()
0 Karma

jpass
Contributor

I know this is a bit old but here's how I authenticate with Basic HTTP Auth:

import requests
from requests.auth import HTTPBasicAuth

username = "<user>"
apikey = "<pass>"
apiurl = "<theurlyouconnectto>"

with requests.Session() as s:
    s.auth = (username,apikey)
    r = s.get(apiurl)    
0 Karma
Get Updates on the Splunk Community!

Celebrating the Winners of the ‘Splunk Build-a-thon’ Hackathon!

We are thrilled to announce the winners of the Splunk Build-a-thon, our first-ever hackathon dedicated to ...

Why You Should Register for Splunk University at .conf25

Level up before .conf25 even begins Splunk University is back in Boston, September 6–8, and it’s your chance ...

Building Splunk proficiency is a marathon, not a sprint

Building Splunk skills is a lot like training for a marathon. It’s about consistent progress, celebrating ...