Deployment Architecture

How to identify whether duplicates are happening from forwarders configuration or indexers?

PramodhKumar
Explorer

Hi Splunk Chaps,

We are having issues with a data source where events are duplicated in the cluster.
Strange that there are duplicate as well as non-duplicate events for few source types.
Also looked at index time for those duplicated events and it is exactly same for both events so not sure whether to point to forwarders configuration.

Any help would be appreciated.

Or let me know How to identify whether duplicates are happening from forwarders configuration or indexers?

Thanks
Pramodh

0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

View solution in original post

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

0 Karma

PramodhKumar
Explorer

Namaskra Giuseppe,

It seems like lissue is getting sorted, problem is with data itself has duplicates.

Regards,
Pramodh

0 Karma
Get Updates on the Splunk Community!

AppDynamics Summer Webinars

This summer, our mighty AppDynamics team is cooking up some delicious content on YouTube Live to satiate your ...

SOCin’ it to you at Splunk University

Splunk University is expanding its instructor-led learning portfolio with dedicated Security tracks at .conf25 ...

Credit Card Data Protection & PCI Compliance with Splunk Edge Processor

Organizations handling credit card transactions know that PCI DSS compliance is both critical and complex. The ...