All Apps and Add-ons

Obtaining cluster centres details from K-Means algorithm

kiril123
Path Finder

I am using K-Means algorithm from Machine Learning toolkit to cluster some data.
After algorithm has converged i can see two new fields appended to the original data - cluster ID and cluster distance.

This is great, however I also need cluster centre details for each cluster. I need this information to calculate distance to each cluster centre from new data points and then assign these data points to the appropriate cluster.

Is there any way to accomplish this in Splunk?

0 Karma
1 Solution

aoliner_splunk
Splunk Employee
Splunk Employee

You can inspect the KMeans model you built with fit using the summary command:

| summary <your_model_name>

Although, if you're trying to assign new points to the appropriate cluster, you can simply apply your model:

<new_points> | apply <your_model_name>

View solution in original post

aljohnson_splun
Splunk Employee
Splunk Employee

You can also use the cluster distance to calculate centroids of a sort:

| inputlookup iris.csv 
| fit KMeans k=3 petal* 
| eval point_size = 1 
| appendpipe 
    [| stats mean(petal*) as petal* by cluster 
    | eval species = "Centroid: ".cluster
    | eval point_size = 2] 
| fields species  petal* point_size

alt text

aoliner_splunk
Splunk Employee
Splunk Employee

You can inspect the KMeans model you built with fit using the summary command:

| summary <your_model_name>

Although, if you're trying to assign new points to the appropriate cluster, you can simply apply your model:

<new_points> | apply <your_model_name>

kiril123
Path Finder

This is great. Thank you.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...