Splunk Search

Using multiple parameters for regexp host extraction

patrickprodoehl
Explorer

Dear community,

I am lost in creating a regexp that will ease up my data input creation.

So I do have a file share being monitored by splunk with the following structure:

/data/reports/ApplicationA/LocationA/very_interesting.log
/data/reports/ApplicationA/LocationB/very_interesting.log
/data/reports/ApplicationB/LocationB/very_interesting.log

To scale at ease, I would like to define a single data input for ApplicationA which extracts the host using 2 parameters of the path. i.e.

ApplicationA_LocationA
ApplicationA_LocationB

Do you have any idea, how I could transform the / between ApplicationA and the location subfolders to a _ and after do the pattern matching to extract the host?

Thanks in advance!

Labels (1)
0 Karma
1 Solution

manjunathmeti
Champion

You need to use transforms.conf. Set <spec> to your sourcetype name or source (source::/data/reports/*/*/*.log).

props.conf

[<spec>]
TRANSFORMS-colorchange

transforms.conf

[set_host]
SOURCE_KEY = MetaData:Source
REGEX = (\w+)\/(\w+)\/\w+\.log$
FORMAT = host::$1_$2
DEST_KEY = MetaData:Host

View solution in original post

manjunathmeti
Champion

You need to use transforms.conf. Set <spec> to your sourcetype name or source (source::/data/reports/*/*/*.log).

props.conf

[<spec>]
TRANSFORMS-colorchange

transforms.conf

[set_host]
SOURCE_KEY = MetaData:Source
REGEX = (\w+)\/(\w+)\/\w+\.log$
FORMAT = host::$1_$2
DEST_KEY = MetaData:Host

patrickprodoehl
Explorer

awesome! works for me with two adaptions:

props.conf

[source::/data/reports/*/*/*.log]
TRANSFORMS-hostExtract = hostExtract

transforms.conf
[hostExtract]
SOURCE_KEY = MetaData:Source
REGEX = (\w+)\/(\w+)\/\w+.log$
FORMAT = host::$1_$2
DEST_KEY = MetaData:Host

0 Karma
Get Updates on the Splunk Community!

Why You Can't Miss .conf25: Unleashing the Power of Agentic AI with Splunk & Cisco

The Defining Technology Movement of Our Lifetime The advent of agentic AI is arguably the defining technology ...

Deep Dive into Federated Analytics: Unlocking the Full Power of Your Security Data

In today’s complex digital landscape, security teams face increasing pressure to protect sprawling data across ...

Your summer travels continue with new course releases

Summer in the Northern hemisphere is in full swing, and is often a time to travel and explore. If your summer ...