Getting Data In

How to monitor multiple files across multiple subdirectories

slrobeson
Engager

We are new to Splunk and are trying it before we buy it. I am having trouble getting Splunk to monitor the individual log files that capture transaction data, of which there is one for each register in each store, and each store has its own subdirectory off of the main directory.

All of the files in question are named ####_#_scanLog, where #### is the store number and # is the terminal number. Each store's files are in a directory named ####_scanLogs, where, again, the #### is the store number. I have tried the following in inputs.conf, and none have worked:

[monitor:///usr/local/copient/logs/*_scanLogs]
disabled = false
index = transactions
sourcetype = scanlog
crcSalt = <SOURCE>

[monitor:///usr/local/copient/logs/*_scanLogs/*_scanLog]
disabled = false
index = transactions
sourcetype = scanlog
crcSalt = <SOURCE>

[monitor:///usr/local/copient/logs/]
disabled = false
index = transactions
sourcetype = scanlog
crcSalt = <SOURCE>
whitelist = *_scanLog

[monitor:///usr/local/copient/logs/]
disabled = false
index = transactions
sourcetype = scanlog
crcSalt = <SOURCE>

None of these have worked. In addition to this monitoring stanza, we also have two others which monitor specific files within the logs directory, and these work fine.

Any ideas would be appreciated.

Tags (2)
0 Karma
1 Solution

javiergn
Super Champion

What about:

[monitor:///usr/local/copient/logs/.../*_scanLog]
disabled = false
index = transactions
sourcetype = scanlog

Note that I've removed the crcSalt.

View solution in original post

javiergn
Super Champion

What about:

[monitor:///usr/local/copient/logs/.../*_scanLog]
disabled = false
index = transactions
sourcetype = scanlog

Note that I've removed the crcSalt.

Get Updates on the Splunk Community!

Splunk Enterprise Security 8.x: The Essential Upgrade for Threat Detection, ...

Watch On Demand the Tech Talk on November 6 at 11AM PT, and empower your SOC to reach new heights! Duration: ...

Splunk Observability as Code: From Zero to Dashboard

For the details on what Self-Service Observability and Observability as Code is, we have some awesome content ...

[Puzzles] Solve, Learn, Repeat: Character substitutions with Regular Expressions

This challenge was first posted on Slack #puzzles channelFor BORE at .conf23, we had a puzzle question which ...