https://community.splunk.com/t5/Getting-Data-In/Why-do-some-logs-stop-forwarding-while-others-continue/m-p/163585#M33161 <P>In our environment, our application logs all go to a single log folder divided by application.</P> <P>Ex...</P> <PRE><CODE>/scratch/content/logs/app1/app1.log /scratch/content/logs/app2/app2.log /scratch/content/logs/app3/app3.log </CODE></PRE> <P>My monitor stanza is very simple...</P> <PRE><CODE>[monitor:///scratch/content/logs] index = apps blacklist = (weblogic) whitelist = \.(log|txt|out)$ </CODE></PRE> <P>For some reason, every day from 1000 to 1500, the app2.log stops being indexed. The log itself is being updated on the server, those updates just aren't being indexed during the 5 hour window. All the other app logs on the same server continue indexing all day. Has anyone ever seen this behavior before?</P> Fri, 07 Aug 2015 12:59:13 GMT kurtgad 2015-08-07T12:59:13Z https://community.splunk.com/t5/Getting-Data-In/Why-do-some-logs-stop-forwarding-while-others-continue/m-p/163585#M33161 <P>In our environment, our application logs all go to a single log folder divided by application.</P> <P>Ex...</P> <PRE><CODE>/scratch/content/logs/app1/app1.log /scratch/content/logs/app2/app2.log /scratch/content/logs/app3/app3.log </CODE></PRE> <P>My monitor stanza is very simple...</P> <PRE><CODE>[monitor:///scratch/content/logs] index = apps blacklist = (weblogic) whitelist = \.(log|txt|out)$ </CODE></PRE> <P>For some reason, every day from 1000 to 1500, the app2.log stops being indexed. The log itself is being updated on the server, those updates just aren't being indexed during the 5 hour window. All the other app logs on the same server continue indexing all day. Has anyone ever seen this behavior before?</P> Fri, 07 Aug 2015 12:59:13 GMT https://community.splunk.com/t5/Getting-Data-In/Why-do-some-logs-stop-forwarding-while-others-continue/m-p/163585#M33161 kurtgad 2015-08-07T12:59:13Z https://community.splunk.com/t5/Getting-Data-In/Why-do-some-logs-stop-forwarding-while-others-continue/m-p/163586#M33162 <P>So you have 3 files and only 2 are send all the time? How quick are thes files growing?</P> <P>Default is in de outputs.conf<BR /> [tcpout] <BR /> maxConnectionsPerIndexer = <STRONG>2</STRONG></P> <P>The forwarder will only send 2 files a the same time. As long the UF didn’t reach EOF of a file, it won’t switch to another file.<BR /> No EOF can be caused by several options</P> <UL> <LI>File is very big (GB's) </LI> <LI>Network connection is slow/full, so can't get data out.</LI> <LI>etc.</LI> </UL> <P>You could change the setting too:<BR /> [tcpout] <BR /> maxConnectionsPerIndexer = <STRONG>4</STRONG></P> <P>See if this helps</P> Mon, 10 Aug 2015 08:28:28 GMT https://community.splunk.com/t5/Getting-Data-In/Why-do-some-logs-stop-forwarding-while-others-continue/m-p/163586#M33162 teunlaan 2015-08-10T08:28:28Z