Splunk Search

Using transforms.conf to create a new field

mw
Splunk Employee
Splunk Employee

I have events which include:

.... relevant=False ....

and I'd like to transform those at search time into a field that doesn't yet exist:

.... compliant=True ....

I thought that this transforms entry, along with the associated props REPORT would do it, but I'm missing something:

# Flip the relevant result to a compliant field
[rtc_comp]
SOURCE_KEY = relevant
DEST_KEY = compliant
REGEX = False
FORMAT = True

Thanks in advance!

0 Karma
1 Solution

Stephen_Sorkin
Splunk Employee
Splunk Employee

The problem here is probably that regex-based field extractions take place before automatic field=value extractions. Your best bet here isn't to use field extractions to map relevant to compliant, but rather to use a csv lookup table to create the new field. It will be higher performance especially if you want to refer to "compliant" in the search itself.

A good introduction is at: http://blogs.splunk.com/2009/07/27/enriching-data-with-lookups-part-1/ or http://www.splunk.com/base/Documentation/latest/Knowledge/Addfieldsfromexternaldatasources

View solution in original post

Stephen_Sorkin
Splunk Employee
Splunk Employee

The problem here is probably that regex-based field extractions take place before automatic field=value extractions. Your best bet here isn't to use field extractions to map relevant to compliant, but rather to use a csv lookup table to create the new field. It will be higher performance especially if you want to refer to "compliant" in the search itself.

A good introduction is at: http://blogs.splunk.com/2009/07/27/enriching-data-with-lookups-part-1/ or http://www.splunk.com/base/Documentation/latest/Knowledge/Addfieldsfromexternaldatasources

mw
Splunk Employee
Splunk Employee

Thank you, sir! That was my next destination. Incidentally, is there data regarding the performance of various actions, or some sort of performance priority chart?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...