topic Re: Different values for each minute in Getting Data In

Different values for each minute

naty — Tue, 29 Sep 2020 10:53:41 GMT

Hi,

i'm new to splunk and in need for a little help.

we can only access an index that was made for our department.

background:
we are extracting data by REST from our products to Splunk.
one of our data inputs is extracting the following details:
date & time, disk ID, disk Transfer
the data input is getting data every minute.

my problem is this:
for every minute i would like to get the top 10 disks with the highest transfer.

we tried to do something like this:
index=our_index source=... | timechart max(TRANSFER) by DISK_ID limit=10 | sort TRANSFER

what we ended up having is getting the current top 10 disks with the highest transfer rate and the history of them.
the problem is that at some points there must have been different disks that were making more transfer but Splunk isn't showing them because it is searching on the current disks and not on every minute.

i would like to get the data in a panel with the Statistics table visualization or the Column chart visualization.

can anyone assist?

Re: Different values for each minute

sundareshr — Wed, 07 Sep 2016 16:49:00 GMT

Try this

index=our_index source=... | bin span=1m _time | stats max(TRANSFER) as transfer by _time DISK_ID | sort _time - transfer | streamstats count by _time | where count <=10

*UPDATED*

index=our_index source=... | bin span=1m _time | stats max(TRANSFER) as transfer by _time DISK_ID | sort _time - transfer | streamstats count by _time | where count <=5 | eval count="DISK_".count | chart values(DISK_ID) as disk over _time by count

Re: Different values for each minute

somesoni2 — Wed, 07 Sep 2016 16:55:29 GMT

I think you forgot to put a hyphen before transfer (to sort in descending order of transfer rate).

Re: Different values for each minute

naty — Tue, 29 Sep 2020 10:56:50 GMT

Hey,

i have tried the suggestion and i think i was not saying what i search for very good.

let me give an example:

let's say that i want to get the top 5 disks with the most transfer.
i have 100 disks and i want to get the top 5 disks with the highest transfer rate for every minute.

i wish to get the following -

Date & Time DISK_ID1 DISK_ID2 DISK_ID3 DISK_ID4 DISK_ID5

### ###### ###### ####### #######

2016-09-12 10:58 DISK1 DISK64 DISK5 DISK9 DISK12
2016-09-12 10:59 DISK50 DISK32 DISK19 DISK20 DISK5
2016-09-12 11:00 DISK4 DISK27 DISK13 DISK89 DISK65

you can see that for every minute a different disk had the highest level of transfer.

i hope that now i wrote it better 🙂

Re: Different values for each minute

sundareshr — Mon, 12 Sep 2016 14:49:38 GMT

Try the udpated answer

Re: Different values for each minute

naty — Thu, 15 Sep 2016 13:08:37 GMT

it worked!!
thank you 😄