Getting Data In

How to automate the deletion of some data in a CSV file before indexing?

spin691t
New Member

Hello

Every day at 10:00 am, I receive a .csv file with data from 00:00 of the previous day until 10:00 of the current day (34 hours).

I would like to index only the data of the previous day. Currently I open each file, remove data from 00:00 to 10:00 of the current date, save in an index directory and index in Splunk. Do I have to write a script or set a configuration file for an automatic operation?

Thank you in advance.

Tags (3)
0 Karma

somesoni2
Revered Legend

I would write a script to truncate the file and drop it to Splunk monitored folder OR to just configure that script as Scripted input and make script to send data to Splunk directly (no file monitoring required).

spin691t
New Member

Thank you for your answer. What language Is better to write script phyton or perl or ..?

0 Karma

slashnburn
Path Finder

I would recommend Python. From there you can create a scripted input that performs the operation at a specific time.

0 Karma
Get Updates on the Splunk Community!

Index This | I’m short for "configuration file.” What am I?

May 2024 Edition Hayyy Splunk Education Enthusiasts and the Eternally Curious!  We’re back with a Special ...

New Articles from Academic Learning Partners, Help Expand Lantern’s Use Case Library, ...

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Your Guide to SPL2 at .conf24!

So, you’re headed to .conf24? You’re in for a good time. Las Vegas weather is just *chef’s kiss* beautiful in ...