Installation

Installation of S3 compatibility tool "s3tests" failed

emallinger
Path Finder

Hello All,

If you have any idea, please let me now.

 

I tried multiple time to install the s3 tests tool to begin working in migrate to smart storage.

I haven't been able to finish the install.

 

OS: debian 10

Splunk version : 8.1.3

 

Here's the log :

 

 

What does "backend unavailable" mean in this context ?

 

Thanks in advance,

Ema

 

sudo ./bootstrap 
./bootstrap: missing required DEB packages. Installing via sudo.
Lecture des listes de paquets... Fait
Construction de l'arbre des dépendances       
Lecture des informations d'état... Fait
Note : sélection de « libxslt1-dev » au lieu de « libxslt-dev »
libxslt1-dev est déjà la version la plus récente (1.1.32-2.2~deb10u1).
0 mis à jour, 0 nouvellement installés, 0 à enlever et 1 non mis à jour.
Running virtualenv with interpreter /usr/bin/python2
New python executable in /tmp/s3-tests-master/virtualenv/bin/python2
Not overwriting existing python script /tmp/s3-tests-master/virtualenv/bin/python (you must use /tmp/s3-tests-master/virtualenv/bin/python2)
Installing setuptools, pkg_resources, pip, wheel...done.
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
Looking in indexes: http://pnexus.-----------.fr/repository/pypi-python.org/simple
Requirement already up-to-date: pip in ./virtualenv/lib/python2.7/site-packages (20.3.4)
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
Looking in indexes: http://pnexus.---------.fr/repository/pypi-python.org/simple
Collecting setuptools==32.3.1
  Downloading http://pnexus.------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/69/19/b1dff551058ce79d88b1e3688f1c735590d7ddf44d10681512133b35019f/setuptools-32.3.1-py2.py3-none-any.whl (479 kB)
     |████████████████████████████████| 479 kB 43.3 MB/s 
Installing collected packages: setuptools
  Attempting uninstall: setuptools
    Found existing installation: setuptools 44.1.1
    Uninstalling setuptools-44.1.1:
      Successfully uninstalled setuptools-44.1.1
Successfully installed setuptools-32.3.1
DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.
Looking in indexes: http://pnexus.-------------.fr/repository/pypi-python.org/simple
Collecting PyYAML
  Downloading http://pnexus.-------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/ba/d4/3cf562876e0cda0405e65d351b835077ab13990e5b92912ef2bf1a2280e0/PyYAML-5.4.1-cp27-cp27mu-manylinux1_x86_64.whl (574 kB)
     |████████████████████████████████| 574 kB 35.8 MB/s 
Collecting nose>=1.0.0
  Downloading http://pnexus.------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/99/4f/13fb671119e65c4dce97c60e67d3fd9e6f7f809f2b307e2611f4701205cb/nose-1.3.7-py2-none-any.whl (154 kB)
     |████████████████████████████████| 154 kB 39.0 MB/s 
Collecting boto>=2.6.0
  Downloading http://pnexus.------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/23/10/c0b78c27298029e4454a472a1919bde20cb182dab1662cec7f2ca1dcc523/boto-2.49.0-py2.py3-none-any.whl (1.4 MB)
     |████████████████████████████████| 1.4 MB 33.7 MB/s 
Collecting bunch>=1.0.0
  Downloading http://pnexus.-----------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/ef/bf/a4cf1779a4ffb4f610903fa08e15d1f4a8a2f4e3353a02afbe097c5bf4a8/bunch-1.0.1.tar.gz (6.6 kB)
Collecting gevent>=1.0
  Downloading http://pnexus.-----------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/ba/8e/ce4743265b39bd653aabddabf65975df9aa59e1fe53fd16fd7297de1d49e/gevent-21.1.2-cp27-cp27mu-manylinux2010_x86_64.whl (5.0 MB)
     |████████████████████████████████| 5.0 MB 38.3 MB/s 
Collecting isodate>=0.4.4
  Downloading http://pnexus.------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/9b/9f/b36f7774ff5ea8e428fdcfc4bb332c39ee5b9362ddd3d40d9516a55221b2/isodate-0.6.0-py2.py3-none-any.whl (45 kB)
     |████████████████████████████████| 45 kB 57.8 MB/s 
Collecting requests>=0.14.0
  Downloading http://pnexus.--------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/29/c1/24814557f1d22c56d50280771a17307e6bf87b70727d975fd6b2ce6b014a/requests-2.25.1-py2.py3-none-any.whl (61 kB)
     |████████████████████████████████| 61 kB 68.1 MB/s 
Collecting pytz>=2011k
  Downloading http://pnexus.---------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/70/94/784178ca5dd892a98f113cdd923372024dc04b8d40abe77ca76b5fb90ca6/pytz-2021.1-py2.py3-none-any.whl (510 kB)
     |████████████████████████████████| 510 kB 36.2 MB/s 
Collecting ordereddict
  Downloading http://pnexus.----------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/53/25/ef88e8e45db141faa9598fbf7ad0062df8f50f881a36ed6a0073e1572126/ordereddict-1.1.tar.gz (2.1 kB)
Collecting httplib2
  Downloading http://pnexus.-------------.fr/repository/pypi-python.org/files.pythonhosted.org/https/packages/ed/cd/533a1e9e04671bcee5d2854b4f651a3fab9586d698de769d93b05ee2bff1/httplib2-0.19.1.tar.gz (263 kB)
     |████████████████████████████████| 263 kB 30.8 MB/s 
  Installing build dependencies ... done
  Getting requirements to build wheel ... done
ERROR: Exception:
Traceback (most recent call last):
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/cli/base_command.py", line 223, in _main
    status = self.run(options, args)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/cli/req_command.py", line 180, in wrapper
    return func(self, options, args)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/commands/install.py", line 321, in run
    reqs, check_supported_wheels=not options.target_dir
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 180, in resolve
    discovered_reqs.extend(self._resolve_one(requirement_set, req))
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 385, in _resolve_one
    dist = self._get_dist_for(req_to_install)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/resolution/legacy/resolver.py", line 337, in _get_dist_for
    dist = self.preparer.prepare_linked_requirement(req)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 480, in prepare_linked_requirement
    return self._prepare_linked_requirement(req, parallel_builds)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 524, in _prepare_linked_requirement
    req, self.req_tracker, self.finder, self.build_isolation,
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/operations/prepare.py", line 88, in _get_prepared_distribution
    abstract_dist.prepare_distribution_metadata(finder, build_isolation)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/distributions/sdist.py", line 39, in prepare_distribution_metadata
    self._setup_isolation(finder)
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_internal/distributions/sdist.py", line 97, in _setup_isolation
    reqs = backend.get_requires_for_build_wheel()
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_vendor/pep517/wrappers.py", line 178, in get_requires_for_build_wheel
    'config_settings': config_settings
  File "/tmp/s3-tests-master/virtualenv/local/lib/python2.7/site-packages/pip/_vendor/pep517/wrappers.py", line 284, in _call_hook
    raise BackendUnavailable(data.get('traceback', ''))
BackendUnavailable

 

Labels (2)
Tags (2)
0 Karma
1 Solution

s2_splunk
Splunk Employee
Splunk Employee

Hi Ema,

I understand your concern. I have just tried and reproduced your error on a clean Debian 10 install.

I went ahead and filed it as an issue.

View solution in original post

0 Karma

s2_splunk
Splunk Employee
Splunk Employee

I suspect this has something to do with the warning you received earlier in the logs:

DEPRECATION: Python 2.7 reached the end of its life on January 1st, 2020. Please upgrade your Python as Python 2.7 is no longer maintained. pip 21.0 will drop support for Python 2.7 in January 2021. More details about Python 2 support in pip can be found at https://pip.pypa.io/en/latest/development/release-process/#python-2-support pip 21.0 will remove support for this functionality.

 

0 Karma

emallinger
Path Finder

Hello!

Could be !

But all the librairies are embbed in the tool, so it's supposed to be selfsufficient.

Python 3 is available on the machine I'm working on but outside the virtualenv of the tool.

Does this mean that the tests tool recommanded by Splunk we execute before migrating to smart storage (s3) is, in fact, obsolete ?

https://github.com/splunk/s3-tests

True it's been years since anyone contributed to the git project.

Thanks for your opininon on the matter.

Regards,

Ema

0 Karma

s2_splunk
Splunk Employee
Splunk Employee

Hi Ema,

I understand your concern. I have just tried and reproduced your error on a clean Debian 10 install.

I went ahead and filed it as an issue.

View solution in original post

0 Karma

emallinger
Path Finder

Hello !

Thanks you so much !

I was  starting to feel totally out of the loop on this and was wondering if I didn't miss some huge part of understanding. At least now, I know there's corroboration.

Best regards,

Ema

0 Karma

emallinger
Path Finder

Hi,

so... nobody faced this before ?

Regards,

Ema

0 Karma

emallinger
Path Finder

Hi,

Still stuck on that. I really don't get it...

Thanks for any suggestion.

Ema

0 Karma
Did you miss .conf21 Virtual?

Good news! The event's keynotes and many of its breakout sessions are now available online, and still totally FREE!