How to collect data to index in batches

[santosh121]

Dear All,

 I am trying to push some records in patches to splunk i want it to be automated.

Usecase: 

 We have 1 lakh + records in index and we want to push those 1 lakh+ records in batches  of 500 as we will run some logic on them. How can i collect all these records in loop in splunk.

can i collect in "for loop" or only way is via python or node sdk?

Regards,

Santosh

[aasabatini]

Hi @santosh121 

you can use also sh batch in splunk, with the scripted inputs you can schedule when the events are loaded (CRON), anyway it's better read the documentation.

https://docs.splunk.com/Documentation/Splunk/latest/AdvancedDev/ScriptSetup