Getting Data In

How to index duplicate files which has different name

snehalk
Communicator

Hello All,

Is there any application or method in Splunk, where we can index the files(which has same contain) in Splunk but with different file name?

Or Can we identify the duplicate files in Splunk without indexing?

Note: one option is there where we can delete the fishbucket and reindex, but i dont want to go with this option.

Can any one help me on this.

Thanks in Advance.

1 Solution

gcusello
SplunkTrust
SplunkTrust

insert in your inputs.conf stanza the row

crcSalt = <SOURCE>

as described in http://docs.splunk.com/Documentation/Splunk/latest/admin/inputsconf

Bye.
Giuseppe

View solution in original post

gcusello
SplunkTrust
SplunkTrust

insert in your inputs.conf stanza the row

crcSalt = <SOURCE>

as described in http://docs.splunk.com/Documentation/Splunk/latest/admin/inputsconf

Bye.
Giuseppe

snehalk
Communicator

Hello Cusello,

Thank you for quick response, am using below config as suggested by you, and its indexing duplicate files in splunk.

inputs.conf
[monitor://C:\sampleduplicate\duplicatefiles\*]
index=main
sourcetype=vendorduplicate
crcSalt = <SOURCE>

Thank you once again !!

0 Karma

Samir__
Engager

Follow up question on the same topic. I also have files with different name but most of them have exact same contents.

After adding crcSalt = < SOURCE> in inputs.conf, does splunk automatically index previously excluded "duplicates"?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...