Getting Data In

send log to bucket s3

toporagno
Explorer

hello all,

I would need the logs to be sent to my S3 bucket smartstorage after 1 month from my security index, but they should still be accessible for another 5 months.

Labels (1)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

Indexers will automatically copy buckets from local storage to SmartStore/S3 when they roll from hot to warm.  You can try to tune the hot bucket lifetime to 30 days, but I don't recommend it.  Let them roll normally and size your SmartStore cache so it's large enough to hold 30 days' of data.

Use the frozenTimePeriodInSecs setting in indexes.conf to specify the lifetime of the data.  Buckets will be removed from S3 when the newest event in the bucket is older than the specified time.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Get Updates on the Splunk Community!

September Community Champions: A Shoutout to Our Contributors!

As we close the books on another fantastic month, we want to take a moment to celebrate the people who are the ...

Community Content Calendar, October Edition

Welcome to the October edition of our Community Spotlight! The Splunk Community is a treasure trove of ...

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...