Alerting

Splunk Alert Creation for threshhold monitoring ?

bapun18
Communicator

Hi Friends ,

I want to create an alert for my Hadoop Job Monitoring and trigger an alert mail to team notifying or hihglighting only for jobs which has been running for more than 90mins based on which action can be taken.I am attaching the screenshot of my query .Please help me in modifying and fine tuning the query changes if needed. Before i proceed to set an alert for monitoring .alt text

Tags (2)
0 Karma

to4kawa
Ultra Champion
index=hadoopmon_db sourcetype=cm_yarn_metrics_live finalStatus=UNDEFINED elapsedTime > 5400 earliet=-90m@m latest=now 

To alert, if there is more than one result.

0 Karma

kamlesh_vaghela
SplunkTrust
SplunkTrust

@bapun18

Below are my suggestions for your scenario. As per your requirement, you want a jobs which has been running for more than 90mins, so for this 1) you can filter event in search also. 2) You have to set threshold on id field for specific period. It will helps you to restrict alert flooding for single id.

Check below links for Alert Configurations:

https://docs.splunk.com/Documentation/Splunk/8.0.0/DMC/Platformalerts#Configure_platform_alerts_and_...

https://docs.splunk.com/Documentation/Splunk/8.0.0/Alert/Aboutalerts

https://docs.splunk.com/Documentation/Splunk/8.0.0/Alert/ThrottleAlerts

Alert scheduling tips: https://docs.splunk.com/Documentation/Splunk/8.0.0/Alert/AlertSchedulingBestPractices

0 Karma
Get Updates on the Splunk Community!

Routing logs with Splunk OTel Collector for Kubernetes

The Splunk Distribution of the OpenTelemetry (OTel) Collector is a product that provides a way to ingest ...

Welcome to the Splunk Community!

(view in My Videos) We're so glad you're here! The Splunk Community is place to connect, learn, give back, and ...

Tech Talk | Elevating Digital Service Excellence: The Synergy of Splunk RUM & APM

Elevating Digital Service Excellence: The Synergy of Real User Monitoring and Application Performance ...