Splunk Dev

How to collect data to index in batches

santosh121
Explorer

Dear All,

 

 I am trying to push some records in patches to splunk i want it to be automated.

 

Usecase: 

 

 We have 1 lakh + records in index and we want to push those 1 lakh+ records in batches  of 500 as we will run some logic on them. How can i collect all these records in loop in splunk.

can i collect in "for loop" or only way is via python or node sdk?

 

Regards,

Santosh

0 Karma

aasabatini
Motivator

Hi @santosh121 

you can use also sh batch in splunk, with the scripted inputs you can schedule when the events are loaded (CRON), anyway it's better read the documentation.

https://docs.splunk.com/Documentation/Splunk/latest/AdvancedDev/ScriptSetup

 

 

“The answer is out there, Neo, and it’s looking for you, and it will find you if you want it to.”
0 Karma
Get Updates on the Splunk Community!

Splunk Observability Cloud’s AI Assistant in Action Series: Analyzing and ...

This is the second post in our Splunk Observability Cloud’s AI Assistant in Action series, in which we look at ...

Elevate Your Organization with Splunk’s Next Platform Evolution

 Thursday, July 10, 2025  |  11AM PDT / 2PM EDT Whether you're managing complex deployments or looking to ...

Splunk Answers Content Calendar, June Edition

Get ready for this week’s post dedicated to Splunk Dashboards! We're celebrating the power of community by ...