All Apps and Add-ons

How to know/measure if a model is learning?

komnina
New Member

Hi there!

I'm a newbie in machine learning world and I have a doubt.

After training and deploying a model, how to know if it is learning? Or, how to teach it?

Is this an automatic process for each use?

0 Karma

aoliner_splunk
Splunk Employee
Splunk Employee

Hi komnina,

The 'fit' command trains or updates a model; this is the 'learning' step in machine learning. The 'apply' command uses a trained model to make predictions. The model doesn't learn anything new when you apply it. You can fit the model on a schedule, using a saved search, if you'd like it to continue learning from new data, but you should validate that it's learning what you want it to.

The Splunk Machine Learning Toolkit has guided modeling dashboards called 'assistants' that walk you through the process of fitting, validating, and deploying a model (including re-training on a schedule).

Hope that helps!

0 Karma

komnina
New Member

Hi friend!

Thanks for your response.

So the 'machine' learn from several re-trainings (schedule), is this?

Can I use 'assistents' (like 'Predict Numeric Fields' and your statistics) to evaluate whether the model improved from a training to another? i.e. comparing statistics of re-trainings. Is it a good way?

kind regards.

0 Karma

aoliner_splunk
Splunk Employee
Splunk Employee

Correct: the machine "learns" by training or updating a model. You can do each of those either manually or on a schedule.

The assistants have a "Load Existing Settings" tab, which will show you the previous models you built, what their various parameters were, and what validation statistics they achieved. Comparing the statistics of different models is exactly what that tab is for. 🙂

0 Karma

komnina
New Member

Hi, good morning.

Thank you very much. It is very cool.

;>)

kind regards.

0 Karma
Get Updates on the Splunk Community!

Splunk at Cisco Live 2025: Learning, Innovation, and a Little Bit of Mr. Brightside

Pack your bags (and maybe your dancing shoes)—Cisco Live is heading to San Diego, June 8–12, 2025, and Splunk ...

Splunk App Dev Community Updates – What’s New and What’s Next

Welcome to your go-to roundup of everything happening in the Splunk App Dev Community! Whether you're building ...

The Latest Cisco Integrations With Splunk Platform!

Join us for an exciting tech talk where we’ll explore the latest integrations in Cisco + Splunk! We’ve ...