Getting Data In

Monitoring logs on another machine without sending the data to splunk server via ftp

royimad
Builder

Can splunk monitor a log errors.log that exist on another machine without sending the files via ftp/sftp to splunk server and use monitor option in inputs? Is their a simplest way to monitor a distant log file? Can splunk universal forwarder perform this step and do i need to open new ports for that reason ?

0 Karma
1 Solution

datasearchninja
Communicator

You would need to have the files available via a file based network protocol. Options for this could be:

  • nfs
  • cifs/samba
  • sshfs

To monitor a log file, Splunk needs to be able to track which items have already been indexed. Other options involve making a copy locally so that this can be tracked. These options would be:

  • As you suggested, a regular copy of log files scp/ftp etc
  • A scripted input that accessed the file over an ssh session, and appended to a local copy that was read by Splunk.

View solution in original post

datasearchninja
Communicator

You would need to have the files available via a file based network protocol. Options for this could be:

  • nfs
  • cifs/samba
  • sshfs

To monitor a log file, Splunk needs to be able to track which items have already been indexed. Other options involve making a copy locally so that this can be tracked. These options would be:

  • As you suggested, a regular copy of log files scp/ftp etc
  • A scripted input that accessed the file over an ssh session, and appended to a local copy that was read by Splunk.
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...