Deployment Architecture

Splunk Forwarder do not send all data

clementros
Path Finder

Hi,

I have installed splunk forwarder 8.0.2 to send data to the splunk entreprise 7.3.0.

All day, multiple .err files are created on my client server. I want to monitor all of them. Sometimes .err files are empty, sometimes they are small heavy and sometimes they are very big.

In my splunk entreprise web interface i do not see all of my .err file. I can see .err files only from August 3 from October 23. Where is other files for today and other days ?

I had some crc length errors. Know i use the parameter crcSalt = <SOURCE>

Here is my inputs.conf :

[monitor:///prddata/JobOutput/*/*.err]
index=fileauxnfmerrorlogs
sourcetype=fcravd10logfile
crcSalt = <SOURCE>

Here is my outputs.conf:

[tcpout:splunkdev]
server=sapoxt3.os.amadeus.net:9997

How can i troobleshoot this ?

Regards,

0 Karma

kartm2020
Communicator

Hi @clementros

It is always recommended to install the same version in both indexers and forwarders. However the issue is with crclength. So you need to increase the initcrclength attribute value 512 or 1024. Try it first 512 if it doesnt works try with 1024. Increase the value by 256.
Default value of inicrclength is 256

[monitor:///prddata/JobOutput//.err]
index=fileauxnfmerrorlogs
sourcetype=fcravd10logfile
initCrcLength = 1024

Hope it works. Let me know if you are facing error after you did the above changes.

You can also go through the below link.
https://docs.splunk.com/Documentation/Splunk/8.0.2/Data/Howlogfilerotationishandled

Happy splunking!!!

0 Karma

manjunathmeti
SplunkTrust
SplunkTrust

Just search index and see if data is there. Splunk sets sourcetype for small files to too_small.

index=fileauxnfmerrorlogs
0 Karma

clementros
Path Finder

No they are not

0 Karma

gcusello
Legend

Hi @clementros,
probably the problem is that you should always have on Indexers the same or higher release than the Forwarders.
Try to install the same version or upgrade (if possible) the Indexer.
For more infos see at https://docs.splunk.com/Documentation/Forwarder/8.0.2/Forwarder/Compatibilitybetweenforwardersandind...

Ciao.
Giuseppe

clementros
Path Finder

Is my license need to be change or the license is independent from the version ?

0 Karma

gcusello
Legend

Hi @clementros,
License is indipendent by the version.
beware, if you want to upgrade to 8, because the last version is really different and you, before upgrading, have to check apps compatibility.

Ciao.
Giuseppe

Get Updates on the Splunk Community!

Splunk Forwarders and Forced Time Based Load Balancing

Splunk customers use universal forwarders to collect and send data to Splunk. A universal forwarder can send ...

NEW! Log Views in Splunk Observability Dashboards Gives Context From a Single Page

Today, Splunk Observability releases log views, a new feature for users to add their logs data from Splunk Log ...

Last Chance to Submit Your Paper For BSides Splunk - Deadline is August 12th!

Hello everyone! Don't wait to submit - The deadline is August 12th! We have truly missed the community so ...