All Apps and Add-ons

What advanced algorithms does Splunk User Behavior Analytics (UBA) use for its Machine Learning?

matthew_ramsey
Explorer

Such as Recursive Bayesian Estimation etc.. I could not find anything besides the generic Machine Learning terminology.

1 Solution

David
Splunk Employee
Splunk Employee

Splunk UBA implements a variety of machine learning algorithms, including but not limited to Probabilistic Suffix Trees, Markov graphs, and others. However, the specific algorithms implemented, while interesting, should not in our view be a primary aspect of an evaluation. In most cases, there are multiple different algorithms which can detect any particular anomaly. Rather than choosing the “best” academic algorithm, it’s at least as important to implement the selected algorithm properly and tune it in such a way to make it work well at enterprise scale.

For instance, just implementing an algorithm to generate a probabilistic suffix tree isn’t enough. The PST algorithm also has to be implemented in such a way that the tree being generated is regularly pruned so as to not just use up all available storage, and that pruning has to be intelligent enough to keep the important things while discarding the others.

Applying ML to security problems is definitely one of those situations where implementation matters at least as much as algorithm selection if not more.

View solution in original post

David
Splunk Employee
Splunk Employee

Splunk UBA implements a variety of machine learning algorithms, including but not limited to Probabilistic Suffix Trees, Markov graphs, and others. However, the specific algorithms implemented, while interesting, should not in our view be a primary aspect of an evaluation. In most cases, there are multiple different algorithms which can detect any particular anomaly. Rather than choosing the “best” academic algorithm, it’s at least as important to implement the selected algorithm properly and tune it in such a way to make it work well at enterprise scale.

For instance, just implementing an algorithm to generate a probabilistic suffix tree isn’t enough. The PST algorithm also has to be implemented in such a way that the tree being generated is regularly pruned so as to not just use up all available storage, and that pruning has to be intelligent enough to keep the important things while discarding the others.

Applying ML to security problems is definitely one of those situations where implementation matters at least as much as algorithm selection if not more.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...