All Apps and Add-ons

Splunk Machine Learning Toolkit: How to make DBSCAN work with partial fit?

rosho
Communicator

Hi,
I am working on a Forecasting problem. This is my procedure:

a) Standard scaler (supports partial fit)
b) Detect outliers using DBSCAN (does not support partial fit)
c) Forecast with Kalman filter (not sure of this???) or MLP (supports partial fit)

So, I would like to know if this procedure is possible to use "partial fit" (incremental learning)?
Or do all algorithms have to support partial fit?

Thank you.

0 Karma

grana_splunk
Splunk Employee
Splunk Employee

Can you add more detail on your usecase? Also, I would recommend you to use StateSpace algorithm for forecasting as it supports partial fit. Check the documentation here: https://docs.splunk.com/Documentation/MLApp/4.2.0/User/Algorithms#StateSpaceForecast

0 Karma

rosho
Communicator

Hi @grana_splunk

I am predicting the number of logins. My dataset has the number of logins by hour (1 month).

I use a) and b) to clean the data (removing or transforming outliers).
With c) I forecast

a) Standard scaler
b) Detect outliers using DBSCAN
c) Forecast with Kalman filter or MLP

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Community Content Calendar, September edition

Welcome to another insightful post from our Community Content Calendar! We're thrilled to continue bringing ...

Splunkbase Unveils New App Listing Management Public Preview

Splunkbase Unveils New App Listing Management Public PreviewWe're thrilled to announce the public preview of ...

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Are you leveraging automation to its fullest potential in your threat detection strategy?Our upcoming Security ...