Getting Data In

How to filter few lines from an event in splunk

poddraj
Explorer

Hi all,
I am new to splunk and am facing issue while trying to filter lines which has "Dequeue" in the event. I want the lines with Dequeue to be removed from the event before indexing. Below is my transforms.conf which is moving the entire event into nullQueue instead to remove only that line which has Dequeue in it.

[Dequeue]
REGEX = (?m)^(.*Dequeue.*)
DEST_KEY = queue
FORMAT = nullQueue

Sample Event:

|HEM
FTTP
TEST
DTI_EXPRESS
10-118-224-197.ebiz.verizon.com
VOICE
2019-11-27T10:32:00Z
Y
Y
Y
1
5.0
YES
76000001
/CTLHDR
/REQUEST
VOICE
YES
GETCSD
CHELLPA
M
M

 8454255242

YYYYNYYYNNYYYYYNNNYNNNNYNNNYNNYYYYYYYNYYYYYYYYYYYYYYNNNNYNYYYYYYYYYYYYYYYYYYYYYY
Y
/REQUEST
/DELPHI_REQUEST
    11/28 14:36:16.75 ft_acce(19692)874  QueueCommand: DTE_KEY: SID:A391000000-, WPID:76000001, COMMAND:GET-CSD2, FT:INVALID_FT, REQID:391000000, PRIORITY:Default, TIMEOUT:1 sec
    11/28 14:36:16.75 priorit(19692)497  Dequeue: Entry
0 Karma
1 Solution

woodcock
Esteemed Legend

You are using the wrong approach. Use this instead:

SEDCMD-dequeue = s/(?m)^(.*Dequeue.*)//g

View solution in original post

0 Karma

woodcock
Esteemed Legend

You are using the wrong approach. Use this instead:

SEDCMD-dequeue = s/(?m)^(.*Dequeue.*)//g
0 Karma

poddraj
Explorer

My transforms.conf is:

[Dequeue]
REGEX = (?m)^(.*Dequeue.*)
DEST_KEY = queue
FORMAT = nullQueue

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

A Four-Part Event Series: Full Stack Observability For the AI Era

As AI reshapes applications, infrastructure, and the way teams operate, the traditional boundaries of ...

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...