topic Re: Obtaining cluster centres details from K-Means algorithm in All Apps and Add-ons

Obtaining cluster centres details from K-Means algorithm

kiril123 — Wed, 01 Nov 2017 15:04:10 GMT

I am using K-Means algorithm from Machine Learning toolkit to cluster some data.
After algorithm has converged i can see two new fields appended to the original data - cluster ID and cluster distance.

This is great, however I also need cluster centre details for each cluster. I need this information to calculate distance to each cluster centre from new data points and then assign these data points to the appropriate cluster.

Is there any way to accomplish this in Splunk?

Re: Obtaining cluster centres details from K-Means algorithm

aoliner_splunk — Wed, 01 Nov 2017 16:06:20 GMT

You can inspect the KMeans model you built with fit using the summary command:

| summary <your_model_name>

Although, if you're trying to assign new points to the appropriate cluster, you can simply apply your model:

<new_points> | apply <your_model_name>

Re: Obtaining cluster centres details from K-Means algorithm

aljohnson_splun — Wed, 01 Nov 2017 16:40:34 GMT

You can also use the cluster distance to calculate centroids of a sort:

| inputlookup iris.csv 
| fit KMeans k=3 petal* 
| eval point_size = 1 
| appendpipe 
    [| stats mean(petal*) as petal* by cluster 
    | eval species = "Centroid: ".cluster
    | eval point_size = 2] 
| fields species  petal* point_size

Re: Obtaining cluster centres details from K-Means algorithm

kiril123 — Wed, 01 Nov 2017 16:47:01 GMT

This is great. Thank you.