Security

Field Extraction from Indexed field

Poojitha
Communicator

Hi All,

I am trying to extract a value from the indexed field. i.e from source field . I have added the regex in props.conf 

Example : 

source  = 234234324234:us-west-2:firehose_list_tags_for_resource

I want everything after second : (colon) as service i.e firehose_list_tags_for_resource

I have added in props.conf as below :

EXTRACT-service = source([^:]+:[^:]+:(?<service>.+)$)

This has created the field service but fetching wrong value. It is fetching last part of raw data.

Please can anyone help me to understand how can I extract field value from indexed data ? Should I add in transforms.conf as well ?

Please can anyone guide me. It helps me lot

Regards,
PNV

0 Karma

richgalloway
SplunkTrust
SplunkTrust

Tell Splunk which field to extract from by using the in option.

EXTRACT-service = [^:]+:[^:]+:(?<service>.+)$ in source

 

---
If this reply helps you, Karma would be appreciated.
0 Karma

deepakc
Builder

Use the below as an example, using both props and transforms,  change to your sourcetype that you are using and if it works, change your group names if desired. 

Props.conf
[my_sourcetype]
REPORT-my_service = extract_service


Transforms.conf
[extract_service]
SOURCE_KEY = source
REGEX = [^:]+:(?<my_service>.+)$
FORMAT = my_service::$1

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @Poojitha,

please try this:

| rex field=source ":(?<your_field>\w+)$"

or in props.conf:

EXTRACT-service = EXTRACT-service = source([^:]+:[^:]+:(?<service>.+)$) in source

that you can test at https://regex101.com/r/NBjX8h/1

ciao.

Giuseppe

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...