Apparently the Qualys Technology Add-on (TA) for Splunk stops fetching data after 503-errors. First it will try 3 times and after the third 503 (Service Unavailable) it starts redirecting and to unclear where. The redirected requests are tried for an infinite number of times. The only way out is to kill the python-script. At the next fetch-interval it will start automatically and continues collecting data without problems. This happens for all three input-types (host_detection, was_findings, policy_posture).
Any idea how to solve this? Thanks!
Here is the logging for host_detection only:
TA-QualysCloudPlatform: 2018-08-23 22:00:14 PID=16129 [MainThread] INFO: TA-QualysCloudPlatform [host_detection] -
Making request: https://qualysapi.qualys.eu/msp/about.php with params={}
TA-QualysCloudPlatform: 2018-08-23 22:00:15 PID=16129 [MainThread] ERROR: TA-QualysCloudPlatform [host_detection] -
Unsuccessful while calling API [503 : Service Unavailable]. Retrying: https://qualysapi.qualys.eu/msp/about.php
with params={}. Retry count: 1
Traceback (most recent call last):
File "/opt/splunk/etc/apps/TA-QualysCloudPlatform/bin/qualysModule/lib/api/Client.py", line 253, in get
request = urllib2.urlopen(req, timeout=timeout) # timeout set to bail in case of timeouts
File "/opt/splunk/lib/python2.7/urllib2.py", line 154, in urlopen
response = meth(req, response)
File "/opt/splunk/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/opt/splunk/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/opt/splunk/lib/python2.7/urllib2.py", line 475, in error
return self._call_chain(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 558, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 503: Service Unavailable
TA-QualysCloudPlatform: 2018-08-23 22:05:15 PID=16129 [MainThread] ERROR: TA-QualysCloudPlatform [host_detection] -
Unsuccessful while calling API [503 : Service Unavailable]. Retrying: https://qualysapi.qualys.eu/msp/about.php
with params={}. Retry count: 2
Traceback (most recent call last):
File "/opt/splunk/etc/apps/TA-QualysCloudPlatform/bin/qualysModule/lib/api/Client.py", line 253, in get
request = urllib2.urlopen(req, timeout=timeout) # timeout set to bail in case of timeouts
File "/opt/splunk/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/opt/splunk/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/opt/splunk/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/opt/splunk/lib/python2.7/urllib2.py", line 475, in error
return self._call_chain(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 558, in http_error_default
raise HTTPError(req.get_full_url(), code, msg, hdrs, fp)
HTTPError: HTTP Error 503: Service Unavailable
TA-QualysCloudPlatform: 2018-08-23 22:10:15 PID=16129 [MainThread] ERROR: TA-QualysCloudPlatform [host_detection] -
Unsuccessful while calling API [307 : Temporary Redirect]. Retrying: https://qualysapi.qualys.eu/msp/about.php with
params={}. Retry count: 3
Traceback (most recent call last):
File "/opt/splunk/etc/apps/TA-QualysCloudPlatform/bin/qualysModule/lib/api/Client.py", line 253, in get
request = urllib2.urlopen(req, timeout=timeout) # timeout set to bail in case of timeouts
File "/opt/splunk/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/opt/splunk/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/opt/splunk/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/opt/splunk/lib/python2.7/urllib2.py", line 469, in error
result = self._call_chain(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 635, in http_error_302
new = self.redirect_request(req, fp, code, msg, headers, newurl)
File "/opt/splunk/lib/python2.7/urllib2.py", line 596, in redirect_request
raise HTTPError(req.get_full_url(), code, msg, headers, fp)
HTTPError: HTTP Error 307: Temporary Redirect
TA-QualysCloudPlatform: 2018-08-23 22:15:15 PID=16129 [MainThread] ERROR: TA-QualysCloudPlatform [host_detection] -
Unsuccessful while calling API [307 : Temporary Redirect]. Retrying: https://qualysapi.qualys.eu/msp/about.php with
params={}. Retry count: 4
Traceback (most recent call last):
File "/opt/splunk/etc/apps/TA-QualysCloudPlatform/bin/qualysModule/lib/api/Client.py", line 253, in get
request = urllib2.urlopen(req, timeout=timeout) # timeout set to bail in case of timeouts
File "/opt/splunk/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/opt/splunk/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/opt/splunk/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/opt/splunk/lib/python2.7/urllib2.py", line 469, in error
result = self._call_chain(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 635, in http_error_302
new = self.redirect_request(req, fp, code, msg, headers, newurl)
File "/opt/splunk/lib/python2.7/urllib2.py", line 596, in redirect_request
raise HTTPError(req.get_full_url(), code, msg, headers, fp)
HTTPError: HTTP Error 307: Temporary Redirect
TA-QualysCloudPlatform: 2018-08-27 13:58:33 PID=16129 [MainThread] ERROR: TA-QualysCloudPlatform [host_detection] -
Unsuccessful while calling API [307 : Temporary Redirect]. Retrying: https://qualysapi.qualys.eu/msp/about.php with
params={}. Retry count: 1056
Traceback (most recent call last):
File "/opt/splunk/etc/apps/TA-QualysCloudPlatform/bin/qualysModule/lib/api/Client.py", line 253, in get
request = urllib2.urlopen(req, timeout=timeout) # timeout set to bail in case of timeouts
File "/opt/splunk/lib/python2.7/urllib2.py", line 154, in urlopen
return opener.open(url, data, timeout)
File "/opt/splunk/lib/python2.7/urllib2.py", line 437, in open
response = meth(req, response)
File "/opt/splunk/lib/python2.7/urllib2.py", line 550, in http_response
'http', request, response, code, msg, hdrs)
File "/opt/splunk/lib/python2.7/urllib2.py", line 469, in error
result = self._call_chain(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 409, in _call_chain
result = func(*args)
File "/opt/splunk/lib/python2.7/urllib2.py", line 635, in http_error_302
new = self.redirect_request(req, fp, code, msg, headers, newurl)
File "/opt/splunk/lib/python2.7/urllib2.py", line 596, in redirect_request
raise HTTPError(req.get_full_url(), code, msg, headers, fp)
HTTPError: HTTP Error 307: Temporary Redirect
... View more