Getting Data In

Duplicate Data In Sourcetype

jbender72
Path Finder

Hello,

I have two Domain Controllers that are producing a lot of data, pushing my daily usage over the limit.  I saw that sourcetype WinNetMon and Perfmon:process have the most duplicate logs in them.  How do I reduce the duplication before the indexing occurs saving me on my daily usage?

 

Thank You

 

Labels (4)
0 Karma
1 Solution

General_Talos
Path Finder

Effectively this is not possible to identify/remove duplicate data before indexing.

Since Perfmon:process is always noisy, would recommend to filter only relevant/required data.

View solution in original post

General_Talos
Path Finder

Effectively this is not possible to identify/remove duplicate data before indexing.

Since Perfmon:process is always noisy, would recommend to filter only relevant/required data.

jbender72
Path Finder

ok, thank you

0 Karma
Get Updates on the Splunk Community!

Stay Connected: Your Guide to January Tech Talks, Office Hours, and Webinars!

What are Community Office Hours? Community Office Hours is an interactive 60-minute Zoom series where ...

[Puzzles] Solve, Learn, Repeat: Reprocessing XML into Fixed-Length Events

This challenge was first posted on Slack #puzzles channelFor a previous puzzle, I needed a set of fixed-length ...

Data Management Digest – December 2025

Welcome to the December edition of Data Management Digest! As we continue our journey of data innovation, the ...