Getting Data In

How to configure Splunk to monitor and index a file that is generated by a script daily, even if there is no change?

DavidHourani
Super Champion

Hello,

I would like to monitor a file that is generated by a script. The script is run daily and the results can be the same for many days in a row. Splunk doesn't seem to take consecutive results if they are the same.

Is there any way I can force Splunk to index data daily each time a new file is generated. The only thing changing from one file to the other is the "modified date" while the rest is the same (file name,content, etc..). I don't mind having the same data many times on different dates.

Thank you.
Regards,
David

0 Karma
1 Solution

jmallorquin
Builder

Hi,

One trick that you can do is make a script to print the ouput of the file and index the output, with current time

Hope i help you

View solution in original post

ddrillic
Ultra Champion

As per inputs.conf

alt text

-- Must be in the range 256-1048576.

So, you need to ensure that something is different in the first 256 bytes (unless you change the default). Adding the date or a random number.

DavidHourani
Super Champion

my entire file is the same daily 😄 any solution with something like CRCsalt= ?

0 Karma

jmallorquin
Builder

Hi,

One trick that you can do is make a script to print the ouput of the file and index the output, with current time

Hope i help you

DavidHourani
Super Champion

smart plan 😄 i was looking for something more like CRCsalt= ..don't know if that exists..

0 Karma

jmallorquin
Builder

No for this time sorry.

0 Karma

DavidHourani
Super Champion

Thank you jmallorquin

0 Karma
Get Updates on the Splunk Community!

Introducing the 2024 SplunkTrust!

Hello, Splunk Community! We are beyond thrilled to announce our newest group of SplunkTrust members!  The ...

Introducing the 2024 Splunk MVPs!

We are excited to announce the 2024 cohort of the Splunk MVP program. Splunk MVPs are passionate members of ...

Splunk Custom Visualizations App End of Life

The Splunk Custom Visualizations apps End of Life for SimpleXML will reach end of support on Dec 21, 2024, ...