topic Distinct count when grouped events meet certain criteria in Splunk Search

Distinct count when grouped events meet certain criteria

monkey — Fri, 03 Aug 2012 12:16:24 GMT

Hi there,

I can't for the life of me figure out how to do the following.

I'm analysing some standard web logs.

I want to be able to find out when any unique IP address accesses a particular URI path more than once a second.

The starting point I have for this is as follows:

uri_path=/foo | span=1s timechart dc(clientip)

This shows me when the distinct count of IP addresses accessing this URL per 1 second intervals BUT it includes all instances where the requests are made just once during this span. I only want a distinct count of the IP addresses that requested the URL more than once in the 1 second span.

Does anyone have any idea how to do this?

Many thanks.

Re: Distinct count when grouped events meet certain criteria

yannK — Fri, 03 Aug 2012 15:33:36 GMT

Add a filter condition after :

uri_path=/foo | span=1s timechart dc(clientip) AS distinct_ip | where distinct_ip >1

Re: Distinct count when grouped events meet certain criteria

monkey — Sat, 04 Aug 2012 08:23:43 GMT

Thanks, yannK, but that doesn't quite achieve what I want: it charts data when more than one distinct client IP appears in one second. I only want to chart the count of distinct client IPs where the count of each distinct client IP is more than one.

192.168.1.1
192.168.1.1
192.168.2.2

I.e. if the above client IPs appear in one second, I want to chart "1" for that second (since 192.168.1.1 appears twice).

192.168.1.1
192.168.2.2
192.168.3.3

If the above appear in one second, I want to chart "0" for that second.

Re: Distinct count when grouped events meet certain criteria

yannK — Sun, 05 Aug 2012 05:06:01 GMT

ok so you want how many time EACH distinct ip connects in a 1 second windows. exclude all the ones that connected only one,
then count the number of those distinct ips per second.

uri_path=/foo 
| bucket _time span=1s 
| stats count by _time clientip 
| where count >1 
| timechart span=1s dc(clientip) as distinct_ip

Re: Distinct count when grouped events meet certain criteria

yannK — Mon, 03 Sep 2012 07:09:22 GMT

did it worked for you ?