Deployment Architecture

How to identify whether duplicates are happening from forwarders configuration or indexers?

PramodhKumar
Explorer

Hi Splunk Chaps,

We are having issues with a data source where events are duplicated in the cluster.
Strange that there are duplicate as well as non-duplicate events for few source types.
Also looked at index time for those duplicated events and it is exactly same for both events so not sure whether to point to forwarders configuration.

Any help would be appreciated.

Or let me know How to identify whether duplicates are happening from forwarders configuration or indexers?

Thanks
Pramodh

0 Karma
1 Solution

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

View solution in original post

0 Karma

gcusello
SplunkTrust
SplunkTrust

Hi @PramodhKumar,
could you share the outputs.conf and inputs.conf of your Universal Forwarders that ingest the logs?

Ciao.
Giuseppe

0 Karma

PramodhKumar
Explorer

Namaskra Giuseppe,

It seems like lissue is getting sorted, problem is with data itself has duplicates.

Regards,
Pramodh

0 Karma
Get Updates on the Splunk Community!

Enter the Agentic Era with Splunk AI Assistant for SPL 1.4

  🚀 Your data just got a serious AI upgrade — are you ready? Say hello to the Agentic Era with the ...

Stronger Security with Federated Search for S3, GCP SQL & Australian Threat ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Accelerating Observability as Code with the Splunk AI Assistant

We’ve seen in previous posts what Observability as Code (OaC) is and how it’s now essential for managing ...