Getting Data In

Are Smartstore buckets uploaded to S3 immutable?

thormanrd
Path Finder

Are Smartstore buckets uploaded to S3 immutable?  We've been using Smartstore for almost a year and I have never seen an update to a bucket after its original upload to S3.  Can anyone confirm this?

Labels (1)
Tags (1)
0 Karma
1 Solution

richgalloway
SplunkTrust
SplunkTrust

Just like warm and cold on-prem buckets, S2 buckets never change.

---
If this reply helps you, Karma would be appreciated.

View solution in original post

pBear
Explorer

The whole S3 SmartStore bucket is not immutable. At least in my instance anyway.
The actual index data, tsidx files, and other metadata files subtending the 'db' folder are immutable.

However, data model acceleration files located under the 'dma' folder do get updated/deleted as a normal part of Splunk operation.

Do we have something misconfigured here? Or, is what am what I am saying normal?

richgalloway
SplunkTrust
SplunkTrust

That's normal and is just like on-prem.

---
If this reply helps you, Karma would be appreciated.
0 Karma

richgalloway
SplunkTrust
SplunkTrust

Just like warm and cold on-prem buckets, S2 buckets never change.

---
If this reply helps you, Karma would be appreciated.

cybersecnutant
Explorer

As I am learning with Write-Once-Read-Many (WORM), there are situations where the buckets/tsidx files are re-uploaded when the indexers have hiccups during an upload.

https://community.splunk.com/t5/Deployment-Architecture/smartstore-splunk-smartstore-and-Data-integr...

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

New Release of Federated Search: Bringing Splunk Analytics to More of Your Data

Organizations today are generating more data than ever and storing it across cloud object stores, data lakes, ...

Inside Event Intelligence: How ITSI Turns Network Alerts into Actionable Incidents

Tech Talk Inside Event Intelligence: How ITSI Turns Network Alerts into Actionable Incidents   Correlating ...

Observability Simplified: Combining User Experience, Application Performance & ...

  Tech Talk Network to App: Observability Unlocked   Today’s digital environments span applications, ...