Getting Data In

Why isn't this data indexing?

danillopavan
Communicator

Hello all,

I am trying to filter the data to be indexed however not success. Nothing is indexed.

I have the below log file:

< 2017-12-06 16:25:44.569 Script: Session started.
< 2017-12-06 16:25:44.569 Executing user defined command on command session.
> 2017-12-06 16:25:44.569 [Shell] df -gt /amb/local/sap_sd ; echo "WinSCP: this is end-of-file:$?"
< 2017-12-06 16:25:44.569 Script: Filesystem    GB blocks      Used      Free %Used Mounted on
< 2017-12-06 16:25:44.569 [Shell] Filesystem    GB blocks      Used      Free %Used Mounted on
< 2017-12-06 16:25:44.569 Script: /dev/lvsapsd       9.00      5.21      3.79   58% /amb/local/sap_sd
< 2017-12-06 16:25:44.569 [Shell] /dev/lvsapsd       9.00      5.21      3.79   58% /amb/local/sap_sd
< 2017-12-06 16:25:44.569 [Shell] WinSCP: this is end-of-file:0
> 2017-12-06 16:25:44.569 [Shell] pwd ; echo "WinSCP: this is end-of-file:$?"

And i just would like to index the lines that containing the word "lvsapsd " (4th and 5th lines).

I have configured my props.conf and transforms.conf as below:

[sourcetype]
TRANSFORMS-set= setnull,setparsing

[setnull]
REGEX = .
DEST_KEY = queue
FORMAT = nullQueue

[setparsing]
REGEX = .*(\blvsapsd\b).*/g
DEST_KEY = queue
FORMAT = indexQueue
0 Karma
1 Solution

somesoni2
Revered Legend

Change your transforms.conf entry for setparsing with this (your don't have to match the whole line, specific keywords that can uniquely identify your events to keep will be sufficient)

[setparsing]
 REGEX = lvsapsd
 DEST_KEY = queue
 FORMAT = indexQueue

View solution in original post

0 Karma

somesoni2
Revered Legend

Change your transforms.conf entry for setparsing with this (your don't have to match the whole line, specific keywords that can uniquely identify your events to keep will be sufficient)

[setparsing]
 REGEX = lvsapsd
 DEST_KEY = queue
 FORMAT = indexQueue
0 Karma

danillopavan
Communicator

Just another question...if I would like to include a phrase to be matched like "Script: Filesystem", how I can use in the regex expression?

REGEX = "Script: Filesystem" ?

0 Karma

danillopavan
Communicator

Perfect!! Many thanks!!! 🙂

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

All Work and No Play? Not at .conf26! Unwind at These Evening Events

Between hands-on technical sessions, keynote reveals, and diving into live architectures, .conf26 is packed ...

Join the Hackathon at .conf26 and build a No-Code AI agent

Join us for the AI Agent Buildathon, an in-person, three-hour hands-on Hackathon where you’ll use Splunk Agent ...

Level Up Your Workflow: Mastering Splunk Cloud Management via Terraform

Tech Talk Recap   From Chaos to Control: Scaling Splunk Cloud with Infrastructure as Code Managing apps in ...