Getting Data In

Are there any resources that explain in detail how Splunk works to monitor files on a universal forwarder?

jldebell
Path Finder

I am trying to find a resource that explains how Splunk works to monitor files. I am familiar with the set up of inputs.conf files and from the Splunk Server side, but I am not familiar with the side that has a Universal Forwarder installed. My understanding is a file/log path is set up so the server produces logs and Splunk will then look for the files. Here are some of the questions I receive:

How long should we maintain the logs in the directory to be monitored?
If the log file is reaching the size limit, will a new file will be created?

Will Splunk capture the old information and the new information without losing data?
How quickly will Splunk capture the information and index it?

Basically, any information related to the universal forwarder server side. Information that describes what the users wanting to have logs collected from Splunk should do and how the process will work from their end.

Thanks for your assistance.

Jenn

1 Solution

kml_uvce
Builder

How long should we maintain the logs in the directory to be monitored?
If the log file is reaching the size limit, will a new file will be created?
its upto you, for example you can maintain for 1 day and new file will be generated after 1 day.
Will Splunk capture the old information and the new information without losing data?
yes
How quickly will Splunk capture the information and index it?
as soon as splunk forwarder process reads data from file and sends to indexer , actually it will not take much time and can be in real time if everything works fine like network latency , buffering etc
http://docs.splunk.com/Documentation/Splunk/6.2.0/admin/inputsconf

kamal singh bisht

View solution in original post

0 Karma

kml_uvce
Builder

How long should we maintain the logs in the directory to be monitored?
If the log file is reaching the size limit, will a new file will be created?
its upto you, for example you can maintain for 1 day and new file will be generated after 1 day.
Will Splunk capture the old information and the new information without losing data?
yes
How quickly will Splunk capture the information and index it?
as soon as splunk forwarder process reads data from file and sends to indexer , actually it will not take much time and can be in real time if everything works fine like network latency , buffering etc
http://docs.splunk.com/Documentation/Splunk/6.2.0/admin/inputsconf

kamal singh bisht
0 Karma

jldebell
Path Finder

Thanks for the information regarding the inputs.conf files. I was coming up with the same resource, but I was looking more specifically for the answers to the questions. Are these documented as part of the process? Thank you for your assistance.

0 Karma

jldebell
Path Finder

Here is the information I was looking for.

http://docs.splunk.com/Documentation/Splunk/6.2.1/Data/Monitorfilesanddirectories

Thanks again for your assistance!

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...

Design, Compete, Win: Submit Your Best Splunk Dashboards for a .conf26 Pass

Hello Splunkers,  We’re excited to kick off a Splunk Dashboard contest! We know that dashboards are a primary ...

May 2026 Splunk Expert Sessions: Security & Observability

Level Up Your Operations: May 2026 Splunk Expert Sessions Whether you are refining your security posture or ...