topic Re: Splunk Forwarder do not send all data in Deployment Architecture

Splunk Forwarder do not send all data

clementros — Thu, 12 Mar 2020 13:07:21 GMT

Hi,

I have installed splunk forwarder 8.0.2 to send data to the splunk entreprise 7.3.0.

All day, multiple .err files are created on my client server. I want to monitor all of them. Sometimes .err files are empty, sometimes they are small heavy and sometimes they are very big.

In my splunk entreprise web interface i do not see all of my .err file. I can see .err files only from August 3 from October 23. Where is other files for today and other days ?

I had some crc length errors. Know i use the parameter crcSalt = <SOURCE>

Here is my inputs.conf :

[monitor:///prddata/JobOutput/*/*.err]
index=fileauxnfmerrorlogs
sourcetype=fcravd10logfile
crcSalt = <SOURCE>

Here is my outputs.conf:

[tcpout:splunkdev]
server=sapoxt3.os.amadeus.net:9997

How can i troobleshoot this ?

Regards,

Re: Splunk Forwarder do not send all data

gcusello — Thu, 12 Mar 2020 13:14:12 GMT

Hi @clementros,
probably the problem is that you should always have on Indexers the same or higher release than the Forwarders.
Try to install the same version or upgrade (if possible) the Indexer.
For more infos see at https://docs.splunk.com/Documentation/Forwarder/8.0.2/Forwarder/Compatibilitybetweenforwardersandindexers

Ciao.
Giuseppe

Re: Splunk Forwarder do not send all data

manjunathmeti — Thu, 12 Mar 2020 13:17:11 GMT

Just search index and see if data is there. Splunk sets sourcetype for small files to too_small.

index=fileauxnfmerrorlogs

Re: Splunk Forwarder do not send all data

clementros — Thu, 12 Mar 2020 13:18:20 GMT

Is my license need to be change or the license is independent from the version ?

Re: Splunk Forwarder do not send all data

clementros — Thu, 12 Mar 2020 13:19:06 GMT

No they are not

Re: Splunk Forwarder do not send all data

gcusello — Thu, 12 Mar 2020 13:21:31 GMT

Hi @clementros,
License is indipendent by the version.
beware, if you want to upgrade to 8, because the last version is really different and you, before upgrading, have to check apps compatibility.

Ciao.
Giuseppe

Re: Splunk Forwarder do not send all data

kartm2020 — Thu, 12 Mar 2020 13:22:41 GMT

Hi @clementros

It is always recommended to install the same version in both indexers and forwarders. However the issue is with crclength. So you need to increase the initcrclength attribute value 512 or 1024. Try it first 512 if it doesnt works try with 1024. Increase the value by 256.
Default value of inicrclength is 256

[monitor:///prddata/JobOutput//.err]
index=fileauxnfmerrorlogs
sourcetype=fcravd10logfile
initCrcLength = 1024

Hope it works. Let me know if you are facing error after you did the above changes.

You can also go through the below link.
https://docs.splunk.com/Documentation/Splunk/8.0.2/Data/Howlogfilerotationishandled

Happy splunking!!!