Splunk Search

AnomaliDetection does not detect outlier data

ashishmgupta
Explorer

In the below dataset, there are two different ISPs for the user from their usual ones.
NordVPN for John and Quadranet for Jill – but this search using anomalidetection is detecting only john’s but not Jill’s.
Any idea why and what is the better way to detect the ISP outlier?

source="isp_data2.csv"  index="test" sourcetype="csv"
| anomalydetection "ISP" "EmailAddress" action=annotate
| eval isOutlier = if(probable_cause != "", "1", "0")
| table "ISP" "EmailAddress", probable_cause, isOutlier
| sort 100000 probable_cause

 

 

EmailAddressISPtimestamp
john@example.comComcast1/1/2020
john@example.comComcast1/2/2020
john@example.comComcast1/3/2020
john@example.comComcast1/4/2020
john@example.comComcast1/5/2020
john@example.comComcast1/6/2020
john@example.comComcast1/7/2020
john@example.comComcast1/8/2020
john@example.comComcast1/9/2020
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comNordVPN########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
john@example.comComcast########
jill@example.comSpectrum2/1/2020
jill@example.comSpectrum2/2/2020
jill@example.comSpectrum2/3/2020
jill@example.comSpectrum2/4/2020
jill@example.comSpectrum2/5/2020
jill@example.comSpectrum2/6/2020
jill@example.comSpectrum2/7/2020
jill@example.comSpectrum2/8/2020
jill@example.comSpectrum2/9/2020
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comQuadranet########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum########
jill@example.comSpectrum3/1/2020
0 Karma

tscroggins
Champion

Hi @ashishmgupta,

As a quick fix, try:

| anomalydetection "ISP" "EmailAddress" action=annotate cutoff=false

tayvionp
Explorer

You seem to be missing the filter command
| where isOutlier=1

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Event Series: Splunk Observability Metrics Cost Optimization

Balancing Scale and Spend: Gaining Control Over High-Volume Metrics in Splunk Observability Cloud As ...

Kick the Tires Before You Commit: A Hands-On Tour of the Splunk Observability Cloud ...

Evaluating an enterprise observability platform usually goes like this: fill out a form, get a free trial with ...

Deep insights, no barriers: Splunk Observability Cloud Free Edition

As software delivery cycles continue to accelerate, observability shouldn’t be a luxury — it should be a ...