Getting Data In

Monitoring logs on another machine without sending the data to splunk server via ftp

royimad
Builder

Can splunk monitor a log errors.log that exist on another machine without sending the files via ftp/sftp to splunk server and use monitor option in inputs? Is their a simplest way to monitor a distant log file? Can splunk universal forwarder perform this step and do i need to open new ports for that reason ?

0 Karma
1 Solution

datasearchninja
Communicator

You would need to have the files available via a file based network protocol. Options for this could be:

  • nfs
  • cifs/samba
  • sshfs

To monitor a log file, Splunk needs to be able to track which items have already been indexed. Other options involve making a copy locally so that this can be tracked. These options would be:

  • As you suggested, a regular copy of log files scp/ftp etc
  • A scripted input that accessed the file over an ssh session, and appended to a local copy that was read by Splunk.

View solution in original post

datasearchninja
Communicator

You would need to have the files available via a file based network protocol. Options for this could be:

  • nfs
  • cifs/samba
  • sshfs

To monitor a log file, Splunk needs to be able to track which items have already been indexed. Other options involve making a copy locally so that this can be tracked. These options would be:

  • As you suggested, a regular copy of log files scp/ftp etc
  • A scripted input that accessed the file over an ssh session, and appended to a local copy that was read by Splunk.
Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...

Shape the Future of Splunk: Join the Product Research Lab!

Join the Splunk Product Research Lab and connect with us in the Slack channel #product-research-lab to get ...

Auto-Injector for Everything Else: Making OpenTelemetry Truly Universal

You might have seen Splunk’s recent announcement about donating the OpenTelemetry Injector to the ...