Reporting

How to check log volume indexed per day in a particular index

iqbalintouch
Path Finder

Is there anyway to check how much log is being generated with DEBUG log mode for a particular index?

Let say if index name is my_index and I need to check what is size of log generated for DEBUG mode log

index=my_index DEBUG
@woodcock plz help 🙂

Labels (1)
0 Karma
1 Solution

to4kawa
Ultra Champion
index=my_index TERM("DEBUG") 
| eval len=length(_raw)
| timechart span=1d sum(len) as len_byte
| eval GB=round(len_byte/1024/1024/1024,2)

how about this? @iqbalintouch 

View solution in original post

to4kawa
Ultra Champion

| tstats count where index=my_index TERM("DEBUG") by _time span=1d

@iqbalintouch how about this?

iqbalintouch
Path Finder

@to4kawa thank you for the response. I am getting the result but not sure if that is showing log size..if yes, is there way to convert in GB size?

iqbalintouch_0-1594843810795.png

 

Tags (1)
0 Karma

to4kawa
Ultra Champion

This query counts the events.
How much is  your one event size?

| eval GB=round(count * <your event size(byte)> / 1024 /1024 ,2)

try above.

0 Karma

iqbalintouch
Path Finder

Unfortunately, that I don't know how much data is being sent in a single event since we are seeing these events in REQUEST/RESPONSE which we send/receive from a third party. 😞

@to4kawa 

0 Karma

to4kawa
Ultra Champion
index=my_index TERM("DEBUG") 
| eval len=length(_raw)
| timechart span=1d sum(len) as len_byte
| eval GB=round(len_byte/1024/1024/1024,2)

how about this? @iqbalintouch 

iqbalintouch
Path Finder

@to4kawa thank you, this is great help.
sorry for the late response, also could you please explain the query..how it is calculating 🙂

0 Karma

to4kawa
Ultra Champion

#1 search the text "DEBUG"
#2 calculate the event by length()(unit: byte)
#3 aggregate for bytes
#4 calculate by Giga Byte.

0 Karma
Get Updates on the Splunk Community!

Built-in Service Level Objectives Management to Bridge the Gap Between Service & ...

Wednesday, May 29, 2024  |  11AM PST / 2PM ESTRegister now and join us to learn more about how you can ...

Get Your Exclusive Splunk Certified Cybersecurity Defense Engineer at Splunk .conf24 ...

We’re excited to announce a new Splunk certification exam being released at .conf24! If you’re headed to Vegas ...

Share Your Ideas & Meet the Lantern team at .Conf! Plus All of This Month’s New ...

Splunk Lantern is Splunk’s customer success center that provides advice from Splunk experts on valuable data ...