All Apps and Add-ons

How to best normalize fields for Splunk Common Information Model (CIM)?

larmesto
Path Finder

Hello folks,

I was wondering if you could help me with a dilemma about PERFORMANCE.

I'm normalizing fields in order to use them with Splunk Common Information Model (CIM) and I don't know if using the extraction method like this:

props.conf:
[(?::){0}opsec*]
REPORT-rule_as_rule_id = rule_as_rule_id

transforms.conf:
[rule_as_rule_id]
REGEX = rule=(\w+)
FORMAT = rule_id::$1

OR just use the FIELDALIAS like this:

props.conf:
[(?::){0}opsec*]
FIELDALIAS-opsec_cim_fields = rule_id as rule_id

Can you help me to understand what is the best method, if any?

Thank you in advance!

0 Karma
1 Solution

beatus
Communicator

Field-aliases can be a bigger determent to performance. Martin_mueller (https://answers.splunk.com/users/134323/martin_mueller.html) could probably answer this better than I can with his fantastic .conf talk on the subject: http://conf.splunk.com/session/2015/conf2015_MMueller_Consist_Deploying_OptimizingSplunkKnowledge.pd...

My take-away is - I wouldn't spend a whole lot of time fixing existing sourcetypes, but if you're doing it for a new sourcetype then i'd utilize a regex.

View solution in original post

beatus
Communicator

Field-aliases can be a bigger determent to performance. Martin_mueller (https://answers.splunk.com/users/134323/martin_mueller.html) could probably answer this better than I can with his fantastic .conf talk on the subject: http://conf.splunk.com/session/2015/conf2015_MMueller_Consist_Deploying_OptimizingSplunkKnowledge.pd...

My take-away is - I wouldn't spend a whole lot of time fixing existing sourcetypes, but if you're doing it for a new sourcetype then i'd utilize a regex.

larmesto
Path Finder

Thank you for your answer! I'll try this approach.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

From Data to Insight: Announcing the Winners of the Splunk Dashboard Contest

Hi Splunkers, First off, thank you to everyone who participated in our very first From Data to Insight: The ...

Splunk Developers: Construct Your Future at the .conf26 Builder Bar

Calling all Splunk architects, platform admins, and app developers: the site is open, and the blueprints are ...

Quick connection discovery mode for forwarders

When a Splunk forwarder loses connectivity to its indexers, it does not always reconnect immediately. In many ...