Getting Data In

monitoring directories - once indexed, do I need to keep original source data?

rgonzale6
Path Finder

If I'm simply monitoring a directory and I'm not tailing it, do I need to keep the contents of the directory after it's been indexed? I have no forensic need for the source data.

I've done some small scale testing with this by creating a test file in a monitoring directory, getting it indexed, and then deleting it, and it still shows up in splunk in the relevant index which would seem to me to indicate you do not need to keep the source data.

Tags (1)
1 Solution

hulahoop
Splunk Employee
Splunk Employee

You are correct--the original data source can be removed after indexing. Splunk no longer requires it as a separate copy is now stored in the Splunk datastore. Having said that, you should ensure the appropriate protections are taken to protect and preserve the data in Spllunk should there be any software/hardware failures.

View solution in original post

hulahoop
Splunk Employee
Splunk Employee

You are correct--the original data source can be removed after indexing. Splunk no longer requires it as a separate copy is now stored in the Splunk datastore. Having said that, you should ensure the appropriate protections are taken to protect and preserve the data in Spllunk should there be any software/hardware failures.

rgonzale6
Path Finder

Thanks! Much appreciated.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...