Getting Data In

Why isn't this data indexing?

danillopavan
Communicator

Hello all,

I am trying to filter the data to be indexed however not success. Nothing is indexed.

I have the below log file:

< 2017-12-06 16:25:44.569 Script: Session started.
< 2017-12-06 16:25:44.569 Executing user defined command on command session.
> 2017-12-06 16:25:44.569 [Shell] df -gt /amb/local/sap_sd ; echo "WinSCP: this is end-of-file:$?"
< 2017-12-06 16:25:44.569 Script: Filesystem    GB blocks      Used      Free %Used Mounted on
< 2017-12-06 16:25:44.569 [Shell] Filesystem    GB blocks      Used      Free %Used Mounted on
< 2017-12-06 16:25:44.569 Script: /dev/lvsapsd       9.00      5.21      3.79   58% /amb/local/sap_sd
< 2017-12-06 16:25:44.569 [Shell] /dev/lvsapsd       9.00      5.21      3.79   58% /amb/local/sap_sd
< 2017-12-06 16:25:44.569 [Shell] WinSCP: this is end-of-file:0
> 2017-12-06 16:25:44.569 [Shell] pwd ; echo "WinSCP: this is end-of-file:$?"

And i just would like to index the lines that containing the word "lvsapsd " (4th and 5th lines).

I have configured my props.conf and transforms.conf as below:

[sourcetype]
TRANSFORMS-set= setnull,setparsing

[setnull]
REGEX = .
DEST_KEY = queue
FORMAT = nullQueue

[setparsing]
REGEX = .*(\blvsapsd\b).*/g
DEST_KEY = queue
FORMAT = indexQueue
0 Karma
1 Solution

somesoni2
Revered Legend

Change your transforms.conf entry for setparsing with this (your don't have to match the whole line, specific keywords that can uniquely identify your events to keep will be sufficient)

[setparsing]
 REGEX = lvsapsd
 DEST_KEY = queue
 FORMAT = indexQueue

View solution in original post

0 Karma

somesoni2
Revered Legend

Change your transforms.conf entry for setparsing with this (your don't have to match the whole line, specific keywords that can uniquely identify your events to keep will be sufficient)

[setparsing]
 REGEX = lvsapsd
 DEST_KEY = queue
 FORMAT = indexQueue
0 Karma

danillopavan
Communicator

Just another question...if I would like to include a phrase to be matched like "Script: Filesystem", how I can use in the regex expression?

REGEX = "Script: Filesystem" ?

0 Karma

danillopavan
Communicator

Perfect!! Many thanks!!! 🙂

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Unlocking Unified Insights: New Gigamon Federated Search App for Splunk

In today’s data-heavy environment, organizations are caught in a data distribution dilemma. As data volumes ...

GA: New Data Management App in Splunk Platform

Streamlining Data Management: Introducing a unified experience in Splunk Managing data at scale shouldn’t feel ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...