Splunk Enterprise Security

CEF Files on Syslog-NG with Universal Forwarder

jswilmoth
Engager

We use Websense in the Cloud, and their method for retrieving log files is to use a perl script which pulls down the logs in CEF format. I set up the script on a syslog server, it writes the CEF files are a folder. The syslog server runs the Universal Forwarder to send data to the indexers. I configured a monitor for that folder.

I can the universal forwarder monitoring the files, but they never show up in my searches. We have many other log sources on this syslog server, all are working fine, except they are all in .log format. These are .cef files.

Any help would be appreciated.

Websense Cloud Logging

[monitor:///opt/syslog/logs/websense_cloud/*.cef]
index = syslog
sourcetype = websense:cef
host_segment = 4
ignoreOlderThan = 5d

0 Karma

FrankVl
Ultra Champion

Let's start with some basic data feed troubleshooting:

  • any messages in splunkd.log confirming the forwarder has started to monitor that folder?
  • are you sure permissions on those files are correct for splunk to be able to read them?
  • any errors in splunkd.log on that forwarder related to this feed?
  • what does the forwarder's metrics.log say about this sourcetype?
  • what do your indexer metrics.log say about this sourcetype?
  • have your tried searching for 'all time', in case time stamp extraction isn't working perfectly?
0 Karma
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Observe and Secure All Apps with Splunk

  Join Us for Our Next Tech Talk: Observe and Secure All Apps with SplunkAs organizations continue to innovate ...

Splunk Decoded: Business Transactions vs Business IQ

It’s the morning of Black Friday, and your e-commerce site is handling 10x normal traffic. Orders are flowing, ...

Fastest way to demo Observability

I’ve been having a lot of fun learning about Kubernetes and Observability. I set myself an interesting ...