Deployment Architecture

Duplicate events in every index

snsaxena
Loves-to-Learn Lots

I can see that we are having duplicate events in every index, query used to identify the duplicate events:

index=* |eval myID=_cd |search [search index=* |streamstats count by _raw |search count>1|eval myID=_cd |fields myID ] |stats c(myID) as dpc by index

Query used to get bucket details of these events:

index=* | eval cd=_cd | eval bkt= _bkt | table cd bkt index splunk_server _time source host sourcetype _raw

 

Note: SF and RF are not met and are set to 3:3. We have multisite clustered environment.

Could this issue be due to SF RF not met or somehow SH is showing up data from replicated buckets as well? Is there a fix to this?

Labels (1)
0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...