Getting Data In

csv files are not getting indexed

karthikTIL
Path Finder

hi,
I have lot of csv files under a directory "/opt/splunk/splunkdata/June2014". when i ask splunk to index complete directory, it does not show many files in "search". is it because most of my files have same contents ? How do i make splunk ignore this? fyi., my file names are different.
should i modify crcSalt under "/opt/splunk/etc/system/default" ?if so, to what value?

Tags (2)
0 Karma

karthikTIL
Path Finder

HI,

i was able to solve this problem. there were many input.conf files in different directories as mentioned below and i included crcSalt= in all these files and restarted splunk and it worked.

/opt/splunk/etc/apps/launcher/local/inputs.conf
/opt/splunk/etc/system/local/inputs.conf
/opt/splunk/etc/system/default/inputs.conf

0 Karma

amitkr0201
Explorer

/opt/splunk/etc/system/default/inputs.conf

Any customization to this file might be overwritten if splunk is upgraded.

Better stick changes in

/opt/splunk/etc/system/local/inputs.conf only

0 Karma

karthikTIL
Path Finder

HI Amit,

inputs.conf under "/opt/splunk/etc/system/default" is already having "crcSalt = " in two places. Do i need to replace source inside angled bracket with the directory of my csv files "opt/splunk/splunkdata/June2014" which is my source?I did and restarted splunk but it did not help. please let me know.
Snippet of inputs.conf file is below

[batch://$SPLUNK_HOME/var/spool/splunk]
move_policy = sinkhole
crcSalt =

[batch://$SPLUNK_HOME/var/spool/splunk/...stash_new]
queue = stashparsing
sourcetype = stash_new
move_policy = sinkhole
crcSalt =

0 Karma

amitkr0201
Explorer
crcSalt = <SOURCE>  

should help you.
More about that here

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Casting Call: Compete in Cyber Games

Lights, Camera, SecOps: Apply to Compete in Cyber Games     Think you have what it takes to beat the clock? ...

How Edge Processor's Durable Queue Works

Edge Processor sits in one of the most consequential places in any Splunk pipeline: between your data sources ...