topic Re: Data not ingested for only a few days in Getting Data In

Data not ingested for only a few days

ishugupta — Fri, 12 Sep 2014 18:09:55 GMT

I am facing a weird issue ,A particular file has only been ingested for 4 days day even though we we have been receiving it for last 10 days .
I looked the configuration , inputs.conf and props.conf , they are unchanged and the data got ingested yesterday as well .
I have gone through the logs on the forwarder as well .
Can you please tell me where I can look for error on indexers , or can there be any potential issue that someone can point out?

Re: Data not ingested for only a few days

sowings — Fri, 12 Sep 2014 20:26:16 GMT

More information please:

Is ths new contents on the same filename (i.e. a complete replacement)?

Or is it continued additions to a single file? (i.e. same file growing larger day by day)

Re: Data not ingested for only a few days

ishugupta — Fri, 12 Sep 2014 20:35:23 GMT

we keep on placing new file each day.
I researched more , I checked the log on the indexer license_usage.log , I can see the entry there...still I cant pull up the file on the console..

Re: Data not ingested for only a few days

sowings — Fri, 12 Sep 2014 21:03:48 GMT

If the new file that gets placed there is "too similar" to the prior version, Splunk will refuse to index it on the belief that it already has. By "too similar" I mean "if the first <default> 256 bytes are the same". This size can be updated (see initCrcLength in inputs.conf).