Splunk Search

How to apply rex for a field on mutiple sources

theouhuios
Motivator

Hello

I am trying to change the data of the host field which has already been indexed. The host field has values in 3 different formats . What I am looking to do is to take the value of IP as it is and then for any FQDN's just extract the first part and ignore rest.

  1. IP Address : 10.1.1.1
  2. FQDN 1 = abc123.company.com
  3. FQDN 2 = abc123.ntwrk.company.com

So when I use this regex on the SH rex field=host "(?P<host>\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))" it works without any issues. I have to apply this on /var/log/splunk/.../.../.../*.log a path which is being used as a source for multiple indexes.

So the props.conf I have as

[source::/var/log/splunk/.../.../.../*.log]
TRANSFORMS-replacehostname = replace_host

and transforms .conf as

   [replace_host]
    SOURCE_KEY=fields:host
    REGEX = ^host::(\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))
    FORMAT = host::$1
    DEST_KEY = Metadata:Host

I am sending this to SH and it looks like it doesn't make any change. Any help on why its not working?

Tags (1)
0 Karma

krish3
Contributor

And also as an alternative you can place your rex command in the props.conf as this:

[sourcetype]
.....
EXTRACT-host = (?P<host>\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))

no need of using transforms.conf here

0 Karma

krish3
Contributor

place it on the indexer as well... Since splunk refers transforms.conf during index time.

0 Karma

krish3
Contributor

Try this...

In props.conf:

REPORT-gethost = gethost

In transforms.conf:

[gethost]
SOURCE_KEY = _raw
REGEX = (?<extracted_newhost>(\d+\.\d+\.\d+\.\d+|([A-Za-z0-9]+))$
0 Karma

theouhuios
Motivator

Even this doesn't work, when I try it on [source::/var/log/splunk/.../.../.../*.log]

0 Karma

theouhuios
Motivator

searchhead

0 Karma

krish3
Contributor

where are you placing your props.conf and transforms.conf..

0 Karma
Get Updates on the Splunk Community!

Announcing Scheduled Export GA for Dashboard Studio

We're excited to announce the general availability of Scheduled Export for Dashboard Studio. Starting in ...

Extending Observability Content to Splunk Cloud

Watch Now!   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to leverage ...

More Control Over Your Monitoring Costs with Archived Metrics GA in US-AWS!

What if there was a way you could keep all the metrics data you need while saving on storage costs?This is now ...