All Apps and Add-ons

Does the Splunk For Tivoli Netcool app correctly handles updates to existing events in the alert.status so events are not duplicated?

hmdoan
Explorer

Does anyone know if the Netcool App for Splunk correctly handles updates to existing events in the alert.status table such that updates to it are not sent as new events into Splunk. This has always been the challenge of using an event correlation engine database with Splunk.

I am currently using DB Connect to pull netcool reporting events into a Splunk index. To get past the duplicates issue, I have to clear the index and then pull in the entire netcool event DB again periodically. Just hoping to find a better way.

0 Karma
1 Solution

paulstark
Path Finder

it does not deduplicate events as the object server does.

a new event will be indexed as an INSERT.
subsequent deltas will be indexed as UPDATE.
removal of an event will be indexed as DELETE.

yes, the entire event is sent each time. the App is not designed to manage events; however, i could see it being developed into an outstanding reporting tool.

now that i think on it ... you could write a Splunk query to grab the "first" of a server serial to get the most up-to-date entry ... at the same time maintaining every statechange that the event has experience (ie audit level reporting)

i hope this helps!

View solution in original post

0 Karma

paulstark
Path Finder

it does not deduplicate events as the object server does.

a new event will be indexed as an INSERT.
subsequent deltas will be indexed as UPDATE.
removal of an event will be indexed as DELETE.

yes, the entire event is sent each time. the App is not designed to manage events; however, i could see it being developed into an outstanding reporting tool.

now that i think on it ... you could write a Splunk query to grab the "first" of a server serial to get the most up-to-date entry ... at the same time maintaining every statechange that the event has experience (ie audit level reporting)

i hope this helps!

0 Karma

hmdoan
Explorer

Thanks, Paul.

I've been thinking of using the DBconnect tool to query the Netcool reporting DB every 5 minutes for events where deletedat is NULL into an empty index. This index would be cleared of events before every DBconnect query in order to only have currently open Netcool events.

Reports from this index (call it netcool_near_live_index) would only be 5 minutes off from the live alerts.status table on the object server. In theory, you could make an active event list on Splunk using this index and report on "live" object server events.

0 Karma
Get Updates on the Splunk Community!

Index This | I am a number, but when you add ‘G’ to me, I go away. What number am I?

March 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with another ...

What’s New in Splunk App for PCI Compliance 5.3.1?

The Splunk App for PCI Compliance allows customers to extend the power of their existing Splunk solution with ...

Extending Observability Content to Splunk Cloud

Register to join us !   In this Extending Observability Content to Splunk Cloud Tech Talk, you'll see how to ...