Getting Data In

Why is Powershell generated CSV data that is monitored only getting indexed once and is not indexed again until a Splunk restart?

jamesklassen
Path Finder

I've got an extremely frustrating problem here, at my wit's end and finally coming here.

I've got CSV files being generated by Powershell every 15 minutes. Splunk is set to look at the directory and pull in the CSV files' data. It pulls it in ONCE, and then does not pull the data in again until after Splunk is restarted. What on earth is going on here?

The CSV files look like this, for example:

2016-09-22-13-56-sfbClientConnections.csv

First few lines of the CSV look like this:

"Time","Username","ClientVersion","Fqdn"
"2016-09-22-13:56","user1@domain.com","UCCAPI/15.0.4849.1000 OC/15.0.4849.1000 (Skype for Business)","server1"
"2016-09-22-13:56","user2@domain.com","UCCAPI/15.0.4849.1000 OC/15.0.4849.1000 (Skype for Business)","server2"

inputs.conf looks like this...I've tried with and without the crcSalt:

[monitor://C:\Scripts\SkypeForBusinessClientConnections\logs\*csv]
disabled = false
host = mailmon2
index = sfb
sourcetype = HydroMessaging:SFB:ClientConnections
crcSalt = <SOURCE>

props.conf looks like this:

[HydroMessaging:SFB:ClientConnections]
NO_BINARY_CHECK = 1
pulldown_type = 1
HEADER_MODE = firstline
FIELD_DELIMITER=,
FIELD_QUOTE="
TIME_FORMAT=%Y-%m-%d-%H:%M
TIMESTAMP_FIELDS=Time
0 Karma

lycollicott
Motivator

Try a monitorNoHandle stanza instead of just monitor. (http://docs.splunk.com/Documentation/Splunk/6.4.3/Data/Monitorfilesanddirectories)

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

[Puzzles] Solve, Learn, Repeat: Matching cron expressions

This puzzle (first published here) is based on matching timestamps to cron expressions.All the timestamps ...

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas

Why Splunk Customers Should Attend Cisco Live 2026 Las Vegas     Cisco Live 2026 is almost here, and this ...

Data Management Digest – May 2026

Welcome to the May 2026 edition of Data Management Digest!   As your trusted partner in data innovation, the ...