I wrote python script for modual input in splunk add-on builder, as of now i am able to fetch logs but each time I run, the same logs are indexed in to indexer. I want to implement code in such a way, if there is change in log data only then it has to index. Can some one please help me.
Use data checkpoints in your modular inputs. An example using it could be found in Splunk Add-on for Bamboo if my memory serves me right. Look in the bin folder for the largest Python code file. Good luck!
make the file by python, and index the file.