Splunk Search

AnomaliDetection does not detect outlier data

ashishmgupta
Explorer

In the below dataset, there are two different ISPs for the user from their usual ones.
NordVPN for John and Quadranet for Jill – but this search using anomalidetection is detecting only john’s but not Jill’s.
Any idea why and what is the better way to detect the ISP outlier?

source="isp_data2.csv"  index="test" sourcetype="csv"
| anomalydetection "ISP" "EmailAddress" action=annotate
| eval isOutlier = if(probable_cause != "", "1", "0")
| table "ISP" "EmailAddress", probable_cause, isOutlier
| sort 100000 probable_cause

 

 

EmailAddressISPtimestamp
john@example.comComcast1/1/2020
john@example.comComcast1/2/2020
john@example.comComcast1/3/2020
john@example.comComcast1/4/2020
john@example.comComcast1/5/2020
john@example.comComcast1/6/2020
john@example.comComcast1/7/2020
john@example.comComcast1/8/2020
john@example.comComcast1/9/2020
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comNordVPN########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
jill@example.comSpectrum2/1/2020
jill@example.comSpectrum2/2/2020
jill@example.comSpectrum2/3/2020
jill@example.comSpectrum2/4/2020
jill@example.comSpectrum2/5/2020
jill@example.comSpectrum2/6/2020
jill@example.comSpectrum2/7/2020
jill@example.comSpectrum2/8/2020
jill@example.comSpectrum2/9/2020
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comQuadranet########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum3/1/2020
0 Karma

tscroggins
Champion

Hi @ashishmgupta,

As a quick fix, try:

| anomalydetection "ISP" "EmailAddress" action=annotate cutoff=false

tayvionp
Explorer

You seem to be missing the filter command
| where isOutlier=1

0 Karma
Get Updates on the Splunk Community!

The OpenTelemetry Certified Associate (OTCA) Exam

What’s this OTCA exam? The Linux Foundation offers the OpenTelemetry Certified Associate (OTCA) credential to ...

From Manual to Agentic: Level Up Your SOC at Cisco Live

Welcome to the Era of the Agentic SOC   Are you tired of being a manual alert responder? The security ...

Splunk Classroom Chronicles: Training Tales and Testimonials (Episode 4)

Welcome back to Splunk Classroom Chronicles, our ongoing series where we shine a light on what really happens ...