Deployment Architecture

Is it doable to set all the indexes in one frozenpath and archive all its data in S3 glacier?

ejmin
Path Finder

Hi splunkers,

Is it possible to have all of the indexes have a one frozen directory path setup in archiving to Amazon S3 glacier? Can anyone of you share their thoughts in storing their data in amazon s3 glacier. It would be nice if  you teach me the architecture or what methods needs to be done in archiving data to S3 glacier. 

Labels (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

Yes, it is doable, but not necessarily advisable.  I've seen customers do this and then struggle to locate data they wish to thaw.  With all Splunk buckets in a single S3 bucket, they have no idea which buckets belong to which index.  I recommend a different frozen path for each index for that reason.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

0 Karma

richgalloway
SplunkTrust
SplunkTrust

Yes, it is doable, but not necessarily advisable.  I've seen customers do this and then struggle to locate data they wish to thaw.  With all Splunk buckets in a single S3 bucket, they have no idea which buckets belong to which index.  I recommend a different frozen path for each index for that reason.

---
If this reply helps you, Karma would be appreciated.
0 Karma

ejmin
Path Finder

Ok thanks for your input......

By the way had you ever done archiving to S3 glacier from frozen bucket?

Ill accept it as a solution for my question but Ill appreciate also if you will advise me a method or guide on how to setup this in automatic way like how the splunk forwarder works.

0 Karma

isoutamo
SplunkTrust
SplunkTrust
As I answer your another question it’s doable. Unfortunately I haven’t link to it, but I think that you could find it by google.
r. Ismo
0 Karma

ejmin
Path Finder

Ok thanks @isoutamo  for your inputs.

 

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...