Getting Data In

Why isn't this data indexing?

danillopavan
Communicator

Hello all,

I am trying to filter the data to be indexed however not success. Nothing is indexed.

I have the below log file:

< 2017-12-06 16:25:44.569 Script: Session started.
< 2017-12-06 16:25:44.569 Executing user defined command on command session.
> 2017-12-06 16:25:44.569 [Shell] df -gt /amb/local/sap_sd ; echo "WinSCP: this is end-of-file:$?"
< 2017-12-06 16:25:44.569 Script: Filesystem    GB blocks      Used      Free %Used Mounted on
< 2017-12-06 16:25:44.569 [Shell] Filesystem    GB blocks      Used      Free %Used Mounted on
< 2017-12-06 16:25:44.569 Script: /dev/lvsapsd       9.00      5.21      3.79   58% /amb/local/sap_sd
< 2017-12-06 16:25:44.569 [Shell] /dev/lvsapsd       9.00      5.21      3.79   58% /amb/local/sap_sd
< 2017-12-06 16:25:44.569 [Shell] WinSCP: this is end-of-file:0
> 2017-12-06 16:25:44.569 [Shell] pwd ; echo "WinSCP: this is end-of-file:$?"

And i just would like to index the lines that containing the word "lvsapsd " (4th and 5th lines).

I have configured my props.conf and transforms.conf as below:

[sourcetype]
TRANSFORMS-set= setnull,setparsing

[setnull]
REGEX = .
DEST_KEY = queue
FORMAT = nullQueue

[setparsing]
REGEX = .*(\blvsapsd\b).*/g
DEST_KEY = queue
FORMAT = indexQueue
0 Karma
1 Solution

somesoni2
Revered Legend

Change your transforms.conf entry for setparsing with this (your don't have to match the whole line, specific keywords that can uniquely identify your events to keep will be sufficient)

[setparsing]
 REGEX = lvsapsd
 DEST_KEY = queue
 FORMAT = indexQueue

View solution in original post

0 Karma

somesoni2
Revered Legend

Change your transforms.conf entry for setparsing with this (your don't have to match the whole line, specific keywords that can uniquely identify your events to keep will be sufficient)

[setparsing]
 REGEX = lvsapsd
 DEST_KEY = queue
 FORMAT = indexQueue
0 Karma

danillopavan
Communicator

Just another question...if I would like to include a phrase to be matched like "Script: Filesystem", how I can use in the regex expression?

REGEX = "Script: Filesystem" ?

0 Karma

danillopavan
Communicator

Perfect!! Many thanks!!! 🙂

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Meet Splunk Observability Studio: AI-Assisted OpenTelemetry Instrumentation Without ...

Instrumentation is usually the last step or even an afterthought when building out a project. The feature ...

Federated Search for Cisco Security and Analytics Logging (SAL) is now GA on Splunk ...

Federated Search for Cisco  Security Analytics and Logging (SAL) is now generally available as part of the ...

Your Path to AgenticOps: AI Experiences for Every Splunk Practitioner

Your Path to AgenticOps: AI Experiences for Every Splunk Practitioner   Join us for a demo-driven look at how ...