Monitoring Splunk

Use _indextime for data retention policy?

jinxkamada
Explorer

Is it possible to reconfigure Splunk to use _indextime instead of _time for data retention policy?

0 Karma
1 Solution

PickleRick
SplunkTrust
SplunkTrust

Can't you use time of ingestion as _time (which would influence retention) and use another field for storing your event's time (in this case it could make sense to make it an indexed field).

Buckets are rolled based on either age of data within the bucket (in terms of _time) or index size. That's it.

View solution in original post

richgalloway
SplunkTrust
SplunkTrust

That is not possible.

What problem are you trying to solve?

---
If this reply helps you, Karma would be appreciated.

jinxkamada
Explorer

I am regularly uploading a file over Splunk which I use for my reporting (might include events with various timestamp). 

I don't want data retention policy to be bounded by _time since it might affect the report I am creating. 
I definitely want Splunk to delete older uploads based on indexed time to manage my server disk usage.

Any suggestion will be appreciated!


0 Karma

PickleRick
SplunkTrust
SplunkTrust

Can't you use time of ingestion as _time (which would influence retention) and use another field for storing your event's time (in this case it could make sense to make it an indexed field).

Buckets are rolled based on either age of data within the bucket (in terms of _time) or index size. That's it.

isoutamo
SplunkTrust
SplunkTrust

Or is there a possibility to use separate index for those events and afterwards even swipe out that content?

Anyhow as @PickleRick said a bucket is removed after all events inside it has expired. Using old and new data (timestamp/_time point of view) usually make this to take quite long time.

jinxkamada
Explorer

Most of the indexes we have right now are used for the same purpose of creating a report.

It would have been ideal for me if they can use the Search menu (out-of-the-box UI) so it would save me the hassle of creating a custom UI to point datetime filtering to the correct field.

However, I would say your recommendations do make sense.
Thanks for the inputs!  

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

A Four-Part Event Series: Full Stack Observability For the AI Era

As AI reshapes applications, infrastructure, and the way teams operate, the traditional boundaries of ...

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...