Getting Data In

Data ingestion

krish5vuda
Engager

Hi all. I am ingesting a CSV file from a UF where the CSV is daily updated by the app team at a particular time and  I have seen data in splunk ingesting on hourly basis which should not be the case and it should be ingesting only once per day need suggestions on how to eliminate this and make sure the data is ingesting only once per day

 

  •  

 

 

Labels (1)
0 Karma

Gr0und_Z3r0
Contributor

I believe you will have to update your inputs.conf and write a scripted input configuration to run the job on scheduled time. 
https://docs.splunk.com/Documentation/Splunk/8.2.3/Admin/Inputsconf 

Also the current behavior you mentioned might be due to the enablement of the crcSalt in the inputs.conf that looks for hash change of the file state and if it happens, indexes the new data.

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

How much can you really learn in 3 minutes?

Observability can certainly be hard to understand – there's a lot of jargon and buzzwords and it seems to ...

Event Series: The Agentic SOC: Trust Before Autonomy

AI is fundamentally changing security operations, but true progress requires more than just automation—it ...

Free Professional Services for .conf26 Attendees

This year at .conf26, we are doing something a little different. We are bringing the best minds from ...