Getting Data In

Need help filtering at the indexer

pipegrep
Path Finder

We have a service account that populates /var/log/messages on many systems with 3 lines of text every 5 minutes. I'd like to filter that out.

These entries come in on a single source: /var/log/messages
...and a single source type: syslog

We have 4 indexers that are fed by 12 universal forwarders (in turn fed by many other Windows and linux hosts).

I'm using a deployment server to successfully deploy props.conf and transforms.conf to each of the indexers.

This is my entry in props.conf;

[syslog]
TRANSFORMS-set = setnull

This is my entry in transfro

[setnull]
REGEX = svc_scomlinux
DEST_KEY = queue
FORMAT = nullQueue

I expect any entries coming in on the source/sourcetype and containing the text svc_scomlinux to be discarded, but it's still coming through.

I spent a good part of the day reading answers here, docs and other sources on the web but I'm not getting any traction. What am I missing?

Thanks

Tags (3)
0 Karma
1 Solution

pipegrep
Path Finder

It indeed was something silly. Ultimately I found that my search heads were actually running heavy forwarders and were outside of my deployment changes, subsequently spewing out the events. Thanks.

View solution in original post

0 Karma

pipegrep
Path Finder

It indeed was something silly. Ultimately I found that my search heads were actually running heavy forwarders and were outside of my deployment changes, subsequently spewing out the events. Thanks.

0 Karma

woodcock
Esteemed Legend

This looks correct to me, unless you have misspelled transforms.conf or something silly like that. Are you getting any errors when you start Splunk saying that it cannot find setnull? You should use btool to check out what configurations are actually in place.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Meet the .conf26 AI Agent Buildathon Winners

At the .conf26 AI Agent Buildathon, Splunk users turned their operational expertise into working AI agents ...

Trusted Autonomy in the SOC: A Maturity Journey

AI is compressing attacker timelines and pushing SOC teams beyond human capacity thresholds. The next SOC ...

Supercharging Windows Security Detection Performance: Introducing Hybrid Field ...

Windows event logs—from Security auditing and Sysmon to PowerShell script blocks—form the operational backbone ...