Getting Data In

Minimize Size of Logs being processed??

stevehoweuk
New Member

I have splunk free installed and want to log some remote server but the Security Log is hogging my 500MB daily allowance I am using remote agents, is there a way to only index aspects of the security Log in splunk? Obviously I don't at the moment care about succesful logins and log outs ets

Tags (1)
0 Karma

Drainy
Champion

Ok. So I will assume you are monitoring entire directories at the moment and pulling all logs in.
There is something called a nullQueue in splunk, when an event arrives it goes through several stages of parsing and queues before eventually being indexed. Just before it arrives at the index you can filter off certain events into a "nullQueue". These do not get indexed and simply get written away.

Have a read of;
http://docs.splunk.com/Documentation/Splunk/latest/Deploy/Routeandfilterdatad#Filter_event_data_and_...

If you have any problems then just update your question with anything you've tried and the community can help troubleshoot it further.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

What’s New in Splunk AI: Volume 02

Welcome to the second edition of “What’s New in Splunk AI” where we look at the latest and greatest updates, ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Laser Bananas and Edge Hubs: Exploring Operational Technology (OT) Data Through a ...

  OT is a different environment to traditional IT and can have interesting challenges when interfacing the ...