Splunk Search

How does correlate command work?

emaccaferri
Communicator

Hi!

I would like to know how the correlation percentage between fields is obtained and so on.
Is it possible?
I know that I can read the Python script of some commend like X11, but I couldn't find Correlate.

Thank you,
Erica

0 Karma

jtrucks
Splunk Employee
Splunk Employee

The command seems imbedded in the splunkd binary, but the process is a mathematical construct. For some details on how that statistical approach can work, check out the Statistical Models for Co-occurrence Datapaper written by Hofmann and Puzicha in 1998. I am not sure if these methods are employed in that manner or if the command written by Splunk engineers employs other methods.

Also see the correlate command documentation, which is rather sparse to date.

--
Jesse Trucks
Minister of Magic
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Splunk Community Badges!

  Hey everyone! Ready to earn some serious bragging rights in the community? Along with our existing badges ...

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...