Splunk Search

How expensive is sha256() in computing power?

morethanyell
Builder

Our saved-search is summary-index enabled and is running every 5 minutes.

Each event's uniqueness is a combination of 4 fields and thus I'm planning to add a unique identifier before it gets written to the summary-index e.g. | eval uniqueId = sha256(field1 . field2 . field3 . field4).

One of our use cases is to left-join values from the aforementioned summary index to a lookup table, which already has the same field i.e. uniqueId. The idea is to join the summary index and the lookup table like our good old SQL baby ON uniqueId=uniqueId.

My question is how much computing power will it cost for the saved search to perform the hash? Will it significantly slow down the summary indexing process?

Is it better to do | join type=left field1, field2, field3, field4 rather than | join type=left uniqueId?

Thanks in advance.

0 Karma

adonio
Ultra Champion

try and run the searches and look at the job inspector and see the load of that particular eval

0 Karma

Jeremiah
Motivator

Also be aware there are limits on joins. You should try using stats if possible. See the section on limitations: http://docs.splunk.com/Documentation/Splunk/7.2.0/SearchReference/Join and some alternative ways of performing a join in splunk, there are lots of posts on Splunk answers, here is one: https://answers.splunk.com/answers/568177/replace-join-with-stats-to-merge-events-based-on-c-1.html

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

From Data to Insight: Announcing the Winners of the Splunk Dashboard Contest

Hi Splunkers, First off, thank you to everyone who participated in our very first From Data to Insight: The ...

Splunk Developers: Construct Your Future at the .conf26 Builder Bar

Calling all Splunk architects, platform admins, and app developers: the site is open, and the blueprints are ...

Quick connection discovery mode for forwarders

When a Splunk forwarder loses connectivity to its indexers, it does not always reconnect immediately. In many ...