Splunk Enterprise

S3 Could not find access_key and/or secret_key in a configuration file- How to solve this error?

emallinger
Communicator

Hello all,

I'm trying to connect my indexer cluster to an on premise s3 storage.

I'm using the master node to do it.

I've tested the access credentials with a standalone instance outside my cluster and it works.

 

Now, I'm trying to use 2 different apps to declare volume and index.

Like this :

.../master-apps/common_indexers/local/indexes.conf #volume stanza

[volume:bucket1]
storageType = remote
path = s3://bucket1
remote.s3.endpoint = https://mys3.fr
remote.s3.access_key = xx
remote.s3.secret_key = xx
remote.s3.signature_version = v2
remote.s3.supports_versionning = false
remote.s3.auth_region = EU

.../master-apps/common_indexes/local/indexes.conf #index stanza
[index1]
homePath = $SPLUNK_DB/$_index_name/db
thawedPath = $SPLUNK_DB/$_index_name/thaweddb
coldPath = $SPLUNK_DB/$_index_name/colddb
remotePath = volume:bucket1/$_index_name
 
When validating bundle, I have this error :
<bundle_validation_errors on peer> [Critical] Unable to load remote volume "bucket1" of scheme "s3" referenced by index "index1": Could not find access_key and/or secret_key in a configuration file [Critical] in environment variables or via the AWS metadata endpoint.
 
I don't understand what is wrong...
File precedence is respected. => ie volumes are read before indexes
I verified that splunk is owner of files and has correct access to the files.
 
I'm out of ideas.
 
Thank you in advance for your suggestions.
Regards,
 
Ema
Labels (1)
0 Karma
1 Solution

emallinger
Communicator

Ok, Here's the answer :

 

The access_key need to be encrypted on each indexer separately after disribution with cluster master.

So it only seems to work if you first write it on the master "clear", then apply the bundle.

View solution in original post

0 Karma

emallinger
Communicator

Ok, Here's the answer :

 

The access_key need to be encrypted on each indexer separately after disribution with cluster master.

So it only seems to work if you first write it on the master "clear", then apply the bundle.

0 Karma

emallinger
Communicator

Any idea ? Anyone ?

0 Karma
Get Updates on the Splunk Community!

Maximize the Value from Microsoft Defender with Splunk

 Watch NowJoin Splunk and Sens Consulting for this Security Edition Tech TalkWho should attend:  Security ...

This Week's Community Digest - Splunk Community Happenings [6.27.22]

Get the latest news and updates from the Splunk Community here! News From Splunk Answers ✍️ Splunk Answers is ...

Reminder! Splunk Love Promo: $25 Visa Gift Card for Your Honest SOAR Review With ...

We recently launched our first Splunk Love Special, and it's gone phenomenally well, so we're doing it again, ...