Deployment Architecture

How to identify whether duplicates are happening from forwarders configuration or indexers?

PramodhKumar
Explorer

Hi Splunk Chaps,

We are having issues with a data source where events are duplicated in the cluster.
Strange that there are duplicate as well as non-duplicate events for few source types.
Also looked at index time for those duplicated events and it is exactly same for both events so not sure whether to point to forwarders configuration.

Any help would be appreciated.

Or let me know How to identify whether duplicates are happening from forwarders configuration or indexers?

Thanks
Pramodh

0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

View solution in original post

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

View solution in original post

0 Karma

PramodhKumar
Explorer

Namaskra Giuseppe,

It seems like lissue is getting sorted, problem is with data itself has duplicates.

Regards,
Pramodh

0 Karma
Register for .conf21 Now! Go Vegas or Go Virtual!

How will you .conf21? You decide! Go in-person in Las Vegas, 10/18-10/21, or go online with .conf21 Virtual, 10/19-10/20.