Getting Data In

Filter syslog input before indexing

bumjubeo
Explorer

I am looking to filter my syslog traffic before it gets indexed by splunk as we are getting a fair bit of fluff from our esxi hosts.

This is what I have setup so far, and it doesnt appear to be working....it may be an error on my regex, I'm hoping not haha.

-props.conf-

[source::SyslogVMware] TRANSFORMS-null = setnull

-transforms.conf-

[setnull] REGEX = [hostd] DEST_KEY = queue FORMAT = nullQueue

I am hoping to remove all alerts recieved from hostd before being indexed, but this doesnt appear to filter anything and i'm hoping I can get a quick pointer in the right direction.

Thanks!

Tags (1)
0 Karma

bumjubeo
Explorer

Type your custom source correctly and this issue wont be a problem. 😉

bumjubeo
Explorer

Ends up the initial regex Hostd: wasn't actually working because Vpxa was being so chatty I didnt notice any Hostd logs, upon further filtering the search I noticed Hostd was sending logs. Looked at my custom source name and I was using the Sourcetype name and not the Source name.

0 Karma

bumjubeo
Explorer

Figured out a bit....my regex didnt need [hostd].

I made my REGEX = Hostd:

and this worked, I am not working on the or command which should be a pipe...arent the conf files using perl regexes?

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Self-Healing Pipeline Is Now Generally Available: AI-Powered CIM Compliance

Maintaining data integrity across security and analytics pipelines is an ongoing challenge. Data ...

Meet Splunk Observability Studio: AI-Assisted OpenTelemetry Instrumentation Without ...

Instrumentation is usually the last step or even an afterthought when building out a project. The feature ...

Federated Search for Cisco Security and Analytics Logging (SAL) is now GA on Splunk ...

Federated Search for Cisco  Security Analytics and Logging (SAL) is now generally available as part of the ...