Getting Data In

Experiences rolling frozen storage into HSM (Hierarchal Storage Management)

dwaddle
SplunkTrust
SplunkTrust

Does anyone have experience integrating splunk with a hierarchal storage management system (like AMASS, Legato, or Tivoli Storage Manager), specifically with respect to frozen data?

The general idea behind all of these products is the data is 'transparently' migrated to tape/optical and leave behind an inode. There's a piece of kernel extension that picks up on open() / read() against the dummy inode and pulls that data back onto local storage.

I can't see any concrete reason why Splunk would not support such an arrangement for frozen index data, but wanted to see if anyone had experience in how it might work in practice.

Tags (1)
1 Solution

gkanapathy
Splunk Employee
Splunk Employee

No reason it wouldn't work, assuming it can work on an entire directory at a time. Just understand that while you could script Splunk to roll data out of cold into frozen and then into HSM, Splunk will never on its own read back the inode. Once it's frozen, Splunk forgets everything about it and it will be up to you (or whoever) to bring the data back to someplace where Splunk will look at it (e.g., the thawed folder)

View solution in original post

gkanapathy
Splunk Employee
Splunk Employee

No reason it wouldn't work, assuming it can work on an entire directory at a time. Just understand that while you could script Splunk to roll data out of cold into frozen and then into HSM, Splunk will never on its own read back the inode. Once it's frozen, Splunk forgets everything about it and it will be up to you (or whoever) to bring the data back to someplace where Splunk will look at it (e.g., the thawed folder)

Get Updates on the Splunk Community!

2024 Splunk Career Impact Survey | Earn a $20 gift card for participating!

Hear ye, hear ye! The time has come again for Splunk's annual Career Impact Survey!  We need your help by ...

Optimize Cloud Monitoring

  TECH TALKS Optimize Cloud Monitoring Tuesday, August 13, 2024  |  11:00AM–12:00PM PST   Register to ...

What's New in Splunk Cloud Platform 9.2.2403?

Hi Splunky people! We are excited to share the newest updates in Splunk Cloud Platform 9.2.2403! Analysts can ...