Splunk Search

How does correlate command work?

emaccaferri
Communicator

Hi!

I would like to know how the correlation percentage between fields is obtained and so on.
Is it possible?
I know that I can read the Python script of some commend like X11, but I couldn't find Correlate.

Thank you,
Erica

0 Karma

jtrucks
Splunk Employee
Splunk Employee

The command seems imbedded in the splunkd binary, but the process is a mathematical construct. For some details on how that statistical approach can work, check out the Statistical Models for Co-occurrence Datapaper written by Hofmann and Puzicha in 1998. I am not sure if these methods are employed in that manner or if the command written by Splunk engineers employs other methods.

Also see the correlate command documentation, which is rather sparse to date.

--
Jesse Trucks
Minister of Magic
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Rounding off the Splunk Dashboard Contest

What does a contest-winning Splunk dashboard look like? In this case, it isn't in a browser tab at all. It ...

A Four Part Event Series: AI + Observability: AI Agents, LLMs, Apps, & Infrastructure

AI + Observability: AI Agents, LLMs, Apps, & Infrastructure The rapid evolution of artificial intelligence ...