All Apps and Add-ons

How to best normalize fields for Splunk Common Information Model (CIM)?

larmesto
Path Finder

Hello folks,

I was wondering if you could help me with a dilemma about PERFORMANCE.

I'm normalizing fields in order to use them with Splunk Common Information Model (CIM) and I don't know if using the extraction method like this:

props.conf:
[(?::){0}opsec*]
REPORT-rule_as_rule_id = rule_as_rule_id

transforms.conf:
[rule_as_rule_id]
REGEX = rule=(\w+)
FORMAT = rule_id::$1

OR just use the FIELDALIAS like this:

props.conf:
[(?::){0}opsec*]
FIELDALIAS-opsec_cim_fields = rule_id as rule_id

Can you help me to understand what is the best method, if any?

Thank you in advance!

0 Karma
1 Solution

beatus
Communicator

Field-aliases can be a bigger determent to performance. Martin_mueller (https://answers.splunk.com/users/134323/martin_mueller.html) could probably answer this better than I can with his fantastic .conf talk on the subject: http://conf.splunk.com/session/2015/conf2015_MMueller_Consist_Deploying_OptimizingSplunkKnowledge.pd...

My take-away is - I wouldn't spend a whole lot of time fixing existing sourcetypes, but if you're doing it for a new sourcetype then i'd utilize a regex.

View solution in original post

beatus
Communicator

Field-aliases can be a bigger determent to performance. Martin_mueller (https://answers.splunk.com/users/134323/martin_mueller.html) could probably answer this better than I can with his fantastic .conf talk on the subject: http://conf.splunk.com/session/2015/conf2015_MMueller_Consist_Deploying_OptimizingSplunkKnowledge.pd...

My take-away is - I wouldn't spend a whole lot of time fixing existing sourcetypes, but if you're doing it for a new sourcetype then i'd utilize a regex.

larmesto
Path Finder

Thank you for your answer! I'll try this approach.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Rethinking Zero Trust: From Product Purchases to Logical Control Evidence

Implementing Zero Trust (ZT) across complex environments often falters at the very beginning due to a ...

Preparing your Splunk Environment for OpenSSL3

The Splunk platform will transition to OpenSSL version 3 in a future release. Actions are required to prepare ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...