Splunk Search

Regular expression in log message

nanachu
Path Finder

I'm struggling now.
Could you please help me?

There are two hosts. they have same log data.

the host name is different but the same data is indexed.
host 1 is the master.
If host 1 fails, 2 becomes the master.

If an alert is created as it is, two alerts will be created for the same event. So I am trying to make the same event into one using dedup.

There is a message in the log, only the number changes.

Error message ××× occur

I want to create field to use dedup.
I know it is wrong but I want to do like this one.

message = "Error message \ d \ d \ d occur"
| dedup message

I can't come up with a way.

Could you help me?

Thank you.

0 Karma

aholzel
Communicator

If the number changes than the message is not the same. That is why you still see both messages. What you can do is a replace, to remove the number and than do the dedup. something like this based on the layout of the message field you provided:

| eval message=replace(message, "([^\d]*)(\d*\s*\d*\s*\d*)(.*)","\1\3")
0 Karma

Sfry1981
Communicator

Hi @nanachu

Does what you state about the dedup not work as this should eliminate any duplicate messages and always just pick one from the first host?

Also on the alert you can add a throttle so the same alert is not triggered twice?

You also mentioned about regular expression in the log message. Do you mean you have created a regex to extract from the raw data t get this info?

0 Karma

nanachu
Path Finder

Thank you for helping me.
Sorry, my English is bad.

I can not create field like
because
|eval message = "Error message * * * occur" does not work.
so, I want to know how to create field that put a regular expression in message.

0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...