- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Addon to upload data using python script
Hello, I have written python script which parses information from website, and i want to make addon which will upload data autmatically after parsing done.
from selenium import webdriver
import time
from bs4 import BeautifulSoup
import csv
driver = webdriver.Chrome()
url= "https://tenders.procurement.gov.ge/public/?lang=ge"
driver.maximize_window()
driver.get(url)
time.sleep(5)
content = driver.page_source.encode('utf-8').strip()
soup = BeautifulSoup(content,"html.parser")
officials = soup.findAll("table",{"id":"lastevents"})
file = open('data.log', 'a')
with open('data.log', 'a') as datafile:
for entry in officials:
spas = entry.findAll('td')
dat = [el for el in spas]
for da in dat:
time = da.find('span', {'class':'color-1'}).text
strong = da.find_all('strong')
number, acquirer = [k.text for k in strong]
catergory = da.find('span', {'class':'color-2'}).text
datafile.write(f"Time: {time} ; OperationNumber: {number} ; Acquirer: {acquirer} ; CategoryID: {catergory}\n")
driver.quit()
This is my script, help me please. 🙂
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content
Did you try using Splunk add-on builder? Refer :
https://splunkbase.splunk.com/app/2962/
https://docs.splunk.com/Documentation/AddonBuilder/2.2.0/UserGuide/Overview
- Mark as New
- Bookmark Message
- Subscribe to Message
- Mute Message
- Subscribe to RSS Feed
- Permalink
- Report Inappropriate Content

If you dont make a modular input using Add On Builder you can also send it in via Splunk HTTP Event Collector from outside Splunk.
http://docs.splunk.com/Documentation/Splunk/7.0.3/Data/UsetheHTTPEventCollector
https://github.com/georgestarcher/Splunk-Class-httpevent
