Deployment Architecture

Duplicate events in every index

snsaxena
Loves-to-Learn Lots

I can see that we are having duplicate events in every index, query used to identify the duplicate events:

index=* |eval myID=_cd |search [search index=* |streamstats count by _raw |search count>1|eval myID=_cd |fields myID ] |stats c(myID) as dpc by index

Query used to get bucket details of these events:

index=* | eval cd=_cd | eval bkt= _bkt | table cd bkt index splunk_server _time source host sourcetype _raw

 

Note: SF and RF are not met and are set to 3:3. We have multisite clustered environment.

Could this issue be due to SF RF not met or somehow SH is showing up data from replicated buckets as well? Is there a fix to this?

Labels (1)
0 Karma
Get Updates on the Splunk Community!

October Community Champions: A Shoutout to Our Contributors!

As October comes to a close, we want to take a moment to celebrate the people who make the Splunk Community ...

Community Content Calendar, November Edition

Welcome to the November edition of our Community Spotlight! Each month, we dive into the Splunk Community to ...

Stay Connected: Your Guide to November Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...