Splunk Search

How to check if data exist in coldidx or hotidx?

koshyk
Super Champion

hi
say we have an index called as "my_network". the rollover period is 1 month to cold index. This needs to be tested by Testing team.

How can they test if a particular event/bucket is existing in cold or warm/hot? Is there a more granular way to interrogate within an _index using Search?

0 Karma
1 Solution

esix_splunk
Splunk Employee
Splunk Employee

Look at the dbinspect command. @ http://docs.splunk.com/Documentation/Splunk/6.0/SearchReference/Dbinspect

You can view the various states of the events in the index, what stage in the lifecycle of the bucket they are (hot/warm/cold/frozen) along with the metadata for the events in the buckets.

| dbinspect index=* splunk_server=* 
| search state="*" 
| convert ctime(endEpoch) ctime(startEpoch) 
| table bucketId state path startEpoch endEpoch

That should get you in the general direction of where you want to go..

View solution in original post

javiergn
Super Champion

You could use dbinspect but it's a non-streaming command and therefore not easy to join against streaming searches.
If you are just looking to verify this for very few events then the following should work fine:

index=main earliest=-30d latest=-29d
| head 1
| stats max(_raw) as myraw by _time
| eval mytime = _time
| map search="
    | dbinspect index=main
    | table endEpoch, startEpoch, state
    | eval time = $mytime$
    | eval _raw = $myraw$
    | where $mytime$ >= startEpoch AND $mytime$ <= endEpoch
"

Unless somebody else comes back with an easier approach of course.

Thanks,
Javier

0 Karma

esix_splunk
Splunk Employee
Splunk Employee

Look at the dbinspect command. @ http://docs.splunk.com/Documentation/Splunk/6.0/SearchReference/Dbinspect

You can view the various states of the events in the index, what stage in the lifecycle of the bucket they are (hot/warm/cold/frozen) along with the metadata for the events in the buckets.

| dbinspect index=* splunk_server=* 
| search state="*" 
| convert ctime(endEpoch) ctime(startEpoch) 
| table bucketId state path startEpoch endEpoch

That should get you in the general direction of where you want to go..

koshyk
Super Champion

thanks mate. it worked

0 Karma
Get Updates on the Splunk Community!

Splunk Enterprise Security 8.x: The Essential Upgrade for Threat Detection, ...

Watch On Demand the Tech Talk on November 6 at 11AM PT, and empower your SOC to reach new heights! Duration: ...

Splunk Observability as Code: From Zero to Dashboard

For the details on what Self-Service Observability and Observability as Code is, we have some awesome content ...

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...