Deployment Architecture

Minimizing logging on Splunk Light Forwarder...

balbano
Contributor

Hey Guys,

Just noticed that logging on one of my light forwarders is taking up a lot of space:

myhost[05:15 PM]root:/opt/splunk/var/log/splunk# ls -lh

total 113M

116K -rw------- 1 root root 111K May 6 17:10 audit.log
0 -rw------- 1 root root 0 Apr 26 15:13 btool.log
4.0K -rw------- 1 root root 61 Apr 26 15:13 first_install.log
0 -rw------- 1 root root 0 Apr 26 15:31 intentions.log
12K -rw------- 1 root root 9.5K May 6 17:10 license_audit.log
15M -rw------- 1 root root 15M May 6 17:15 metrics.log
24M -rw------- 1 root root 24M May 5 10:12 metrics.log.1
24M -rw------- 1 root root 24M May 3 05:22 metrics.log.2
24M -rw------- 1 root root 24M May 1 00:30 metrics.log.3
24M -rw------- 1 root root 24M Apr 28 19:48 metrics.log.4
0 -rw------- 1 root root 0 Apr 26 15:31 scheduler.log
0 -rw------- 1 root root 0 Apr 26 15:31 searches.log
0 -rw------- 1 root root 0 Apr 26 15:31 searchhistory.log
2.0M -rw------- 1 root root 2.0M May 6 17:10 splunkd.log
556K -rw------- 1 root root 551K May 6 17:10 splunkd_access.log
4.0K -rw------- 1 root root 110 May 6 17:09 splunkd_stderr.log
0 -rw------- 1 root root 0 Apr 26 15:31 splunkd_stdout.log
0 -rw------- 1 root root 0 Apr 26 15:31 splunklogger.log
36K -rw------- 1 root root 33K Apr 26 15:36 web_access.log
20K -rw------- 1 root root 19K Apr 26 15:36 web_service.log

I don't care too much for these logs since I simply want light forwarder to forward system and application logs to my central log servers.

Anyway to fix this?

Let me know.

Thanks.

B

Tags (1)
1 Solution

Lowell
Super Champion

Lowell
Super Champion

Additional info on this top is available here:

http://www.splunk.com/wiki/Community:MinimizingForwarderFootprint

Simeon
Splunk Employee
Splunk Employee

You can tune the log levels and sizes in $SPLUNK_HOME/etc/log.cfg. After editing this file, you will need to restart Splunk.

The specific parameters you will want to edit are the maxFileSize and maxBackupIndex under each file type.

I recommend you retain as much data as you can since this data is very useful for troubleshooting problems.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Introducing the 2026 - 2027 SplunkTrust cohort!

The goal of the SplunkTrust™ membership has historically been to acknowledge and recognize those who go above ...

Splunk Auto Ingestion Parallel Pipeline Scaling

Why this feature matters Many Splunk environments experience ingestion pressure long before the host is fully ...