Deployment Architecture

Is it doable to set all the indexes in one frozenpath and archive all its data in S3 glacier?

ejmin
Path Finder

Hi splunkers,

Is it possible to have all of the indexes have a one frozen directory path setup in archiving to Amazon S3 glacier? Can anyone of you share their thoughts in storing their data in amazon s3 glacier. It would be nice if  you teach me the architecture or what methods needs to be done in archiving data to S3 glacier. 

Labels (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

Yes, it is doable, but not necessarily advisable.  I've seen customers do this and then struggle to locate data they wish to thaw.  With all Splunk buckets in a single S3 bucket, they have no idea which buckets belong to which index.  I recommend a different frozen path for each index for that reason.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

0 Karma

richgalloway
SplunkTrust
SplunkTrust

Yes, it is doable, but not necessarily advisable.  I've seen customers do this and then struggle to locate data they wish to thaw.  With all Splunk buckets in a single S3 bucket, they have no idea which buckets belong to which index.  I recommend a different frozen path for each index for that reason.

---
If this reply helps you, Karma would be appreciated.
0 Karma

ejmin
Path Finder

Ok thanks for your input......

By the way had you ever done archiving to S3 glacier from frozen bucket?

Ill accept it as a solution for my question but Ill appreciate also if you will advise me a method or guide on how to setup this in automatic way like how the splunk forwarder works.

0 Karma

isoutamo
SplunkTrust
SplunkTrust
As I answer your another question it’s doable. Unfortunately I haven’t link to it, but I think that you could find it by google.
r. Ismo
0 Karma

ejmin
Path Finder

Ok thanks @isoutamo  for your inputs.

 

0 Karma
Get Updates on the Splunk Community!

Strengthen Your Future: A Look Back at Splunk 10 Innovations and .conf25 Highlights!

The Big One: Splunk 10 is Here!  The moment many of you have been waiting for has arrived! We are thrilled to ...

Now Offering the AI Assistant Usage Dashboard in Cloud Monitoring Console

Today, we’re excited to announce the release of a brand new AI assistant usage dashboard in Cloud Monitoring ...

Stay Connected: Your Guide to October Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...