Splunk Search

How expensive is sha256() in computing power?

morethanyell
Builder

Our saved-search is summary-index enabled and is running every 5 minutes.

Each event's uniqueness is a combination of 4 fields and thus I'm planning to add a unique identifier before it gets written to the summary-index e.g. | eval uniqueId = sha256(field1 . field2 . field3 . field4).

One of our use cases is to left-join values from the aforementioned summary index to a lookup table, which already has the same field i.e. uniqueId. The idea is to join the summary index and the lookup table like our good old SQL baby ON uniqueId=uniqueId.

My question is how much computing power will it cost for the saved search to perform the hash? Will it significantly slow down the summary indexing process?

Is it better to do | join type=left field1, field2, field3, field4 rather than | join type=left uniqueId?

Thanks in advance.

0 Karma

adonio
Ultra Champion

try and run the searches and look at the job inspector and see the load of that particular eval

0 Karma

Jeremiah
Motivator

Also be aware there are limits on joins. You should try using stats if possible. See the section on limitations: http://docs.splunk.com/Documentation/Splunk/7.2.0/SearchReference/Join and some alternative ways of performing a join in splunk, there are lots of posts on Splunk answers, here is one: https://answers.splunk.com/answers/568177/replace-join-with-stats-to-merge-events-based-on-c-1.html

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Preparing your Splunk Environment for OpenSSL3

The Splunk platform will transition to OpenSSL version 3 in a future release. Actions are required to prepare ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Catalog Is Now Generally Available on Splunk Cloud Platform

A Unified View of Your Data  Security logs, application events, business data, and historical telemetry often ...