Splunk Search

field extraction based on index

sbsbb
Builder

I have two different indexes, with multiple sources, say source1, source2

How can I define a different Extraction per Index

Index1 SourceA Transform1A
Index2 SourceA Transform2A

I could only specify the source by extractions....

1 Solution

datasearchninja
Communicator

Are you sure you are defining the data correctly? If the SourceA data requires different extractions depending on index, then isn't it going to be a different sourcetype?

If the event data is different, then you could just specify both extractions, and each would only work on the data it matched. IN this case however because the data is different, different sourcetypes should be set.

If the event data really is the same, then you could do this using eval, to create a field that combines index and raw, and then do the extractions from the new field.

props.conf:

EVAL-indexplusraw = index . "-" . _raw
EXTRACT-field1 = index1-(<REGEX>) in indexplusraw
EXTRACT-field2 = index2-(<REGEX>) in indexplusraw

View solution in original post

0 Karma

datasearchninja
Communicator

Are you sure you are defining the data correctly? If the SourceA data requires different extractions depending on index, then isn't it going to be a different sourcetype?

If the event data is different, then you could just specify both extractions, and each would only work on the data it matched. IN this case however because the data is different, different sourcetypes should be set.

If the event data really is the same, then you could do this using eval, to create a field that combines index and raw, and then do the extractions from the new field.

props.conf:

EVAL-indexplusraw = index . "-" . _raw
EXTRACT-field1 = index1-(<REGEX>) in indexplusraw
EXTRACT-field2 = index2-(<REGEX>) in indexplusraw
0 Karma

Ayn
Legend

I believe you cannot specify extractions based on index. You're talking about index and source - what about sourcetype?

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Data Persistence in the OpenTelemetry Collector

This blog post is part of an ongoing series on OpenTelemetry. What happens if the OpenTelemetry collector ...

Introducing Splunk 10.0: Smarter, Faster, and More Powerful Than Ever

Now On Demand Whether you're managing complex deployments or looking to future-proof your data ...

Community Content Calendar, September edition

Welcome to another insightful post from our Community Content Calendar! We're thrilled to continue bringing ...