Monitoring Splunk

Use _indextime for data retention policy?

jinxkamada
Explorer

Is it possible to reconfigure Splunk to use _indextime instead of _time for data retention policy?

0 Karma
1 Solution

PickleRick
SplunkTrust
SplunkTrust

Can't you use time of ingestion as _time (which would influence retention) and use another field for storing your event's time (in this case it could make sense to make it an indexed field).

Buckets are rolled based on either age of data within the bucket (in terms of _time) or index size. That's it.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

That is not possible.

What problem are you trying to solve?

---
If this reply helps you, Karma would be appreciated.

jinxkamada
Explorer

I am regularly uploading a file over Splunk which I use for my reporting (might include events with various timestamp). 

I don't want data retention policy to be bounded by _time since it might affect the report I am creating. 
I definitely want Splunk to delete older uploads based on indexed time to manage my server disk usage.

Any suggestion will be appreciated!


0 Karma

PickleRick
SplunkTrust
SplunkTrust

Can't you use time of ingestion as _time (which would influence retention) and use another field for storing your event's time (in this case it could make sense to make it an indexed field).

Buckets are rolled based on either age of data within the bucket (in terms of _time) or index size. That's it.

isoutamo
SplunkTrust
SplunkTrust

Or is there a possibility to use separate index for those events and afterwards even swipe out that content?

Anyhow as @PickleRick said a bucket is removed after all events inside it has expired. Using old and new data (timestamp/_time point of view) usually make this to take quite long time.

jinxkamada
Explorer

Most of the indexes we have right now are used for the same purpose of creating a report.

It would have been ideal for me if they can use the Search menu (out-of-the-box UI) so it would save me the hassle of creating a custom UI to point datetime filtering to the correct field.

However, I would say your recommendations do make sense.
Thanks for the inputs!  

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...