topic Re: Monitor a directory for new files in Getting Data In

Monitor a directory for new files

adityaanand — Mon, 18 May 2015 12:11:54 GMT

Hi,
I am trying to monitor a directory.
Suppose that there is a directory named test and it contains initially a log file called access.log.
The access.log file contains following data.
210.160.24.63 - - [07/May/2015:18:22:16] "GET /product.screen?productId=WC-SH-A02&JSESSIONID=SD0SL6FF7ADFF4953 HTTP 1.1" 200 3878 "http://www.google.com" "Mozilla/5.0 (Windows NT 6.1; WOW64) AppleWebKit/536.5 (KHTML, like Gecko) Chrome/19.0.1084.46 Safari/536.5" 349
.....
.....
It is showing that 13,628 events are indexed.

Now i added an another file access1.log in same directory (test). with little with changes in the file. I have replace 210.160.24.63 with 190.160.24.63 and all other contents are same as it is.

But still in search It is showing that 13,628 events .

I have checked that through CLI that both files are listed in monitor directory.

But i am not getting expected results i.e. events should be increased.

Please help me .

Re: Monitor a directory for new files

tom_frotscher — Mon, 18 May 2015 12:18:25 GMT

Are the first few lines of the documents exactly the same? Or did the change of the ip influence the also the first few lines of the document?

Re: Monitor a directory for new files

adityaanand — Mon, 18 May 2015 12:22:07 GMT

No the first line of the document is not exactly same.
I have already mentioned that the first line stated with 210.160.24.63 ... is replaced with 190.160.24.63 and rest of are exactly same.

Re: Monitor a directory for new files

tom_frotscher — Mon, 18 May 2015 12:27:40 GMT

Ok, sorry but from your post it was not completely clear for me that you changed the first line.

Can you provide the corresponding monitoring stanza from your inputs.conf ?

Re: Monitor a directory for new files

adityaanand — Mon, 18 May 2015 12:35:16 GMT

[monitor://D:/\Splunk Data/\Testing]
disabled = true
index = splunk_test

Re: Monitor a directory for new files

tom_frotscher — Mon, 18 May 2015 12:36:32 GMT

Your input is disabled, change to disabled = false.

Re: Monitor a directory for new files

adityaanand — Mon, 18 May 2015 12:42:26 GMT

I have changed to disabled = false.
Still i am getting same result.

Re: Monitor a directory for new files

tom_frotscher — Mon, 18 May 2015 12:50:08 GMT

Have you changed this setting in the default or in the local directory? Can you find your input in the web ui? In the web ui and in the correct app context go to settings -> data inputs -> files and directories. Is your input in this list and displayed as "enabled"?

Re: Monitor a directory for new files

adityaanand — Mon, 18 May 2015 12:58:19 GMT

I have made changes in C:\Program Files\Splunk\etc\apps\search\local\inputs.conf.
i have aslo gone through web ui. I found there status= enabled and no. of file = 1.

Re: Monitor a directory for new files

kheli — Mon, 18 May 2015 13:41:33 GMT

add crcSalt = under your monitor stanza