Knowledge Management

Summary Index Backfill - Skipped

rodrigorsilva
Communicator

Hello
I have a scheduled search that populates a summary index. I would like to backfill that summary index for the last 1 day.

When I run this command:

./splunk cmd python fill_summary_index.py -app test_app -name "Report - test" -et -1d@d -lt @d -j 1 -dedup true -nolocal true -auth admin:xxxxx -index sum_test -showprogress true

I get a message:

"Out of 1 scheduled times, 1 will be skipped because they already exist"

Thanks for the tips!

Rodrigo Ribeiro

0 Karma

somesoni2
Revered Legend

It seems like some data is available for the time period you want to backfill. Did the regular schedule of your summary index ran already (and it might have some missing data that you want to backfill)? The flag -dedup will skip the backfill execution if the summary index data for the same period already exist. See Note on following Doc page: https://docs.splunk.com/Documentation/Splunk/7.1.1/Knowledge/Managesummaryindexgapsandoverlaps#Use_t...

0 Karma

rodrigorsilva
Communicator

Thanks somesoni2,

Exactly, I have a JOB that runs "yesterday" every day, but because an error in a search during execution:

"Unknown error for peer server_splunk003. Search Results might be incomplete. If this occurs frequently, please check on the peer"

I have this situation, example:
My JOB scheduled returned 300;
My query ad-hoc in the same period returned 400;

This occurs because a error message, i need to reprocess this difference and add data in summary index...

0 Karma

somesoni2
Revered Legend

Easiest way would be to just delete that incomplete data for yesterday and then run backfill.

0 Karma

rodrigorsilva
Communicator

Maybe my understanding is wrong, this script can be used only in the period i dont have data... That's it?
I thought this script to do a difference too and add fault data, but that does not seem to be the purpose, correct?

Tks,

Rodrigo Ribeiro

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Modernize your Splunk Apps – Introducing Python 3.13 in Splunk

We are excited to announce that the upcoming releases of Splunk Enterprise 10.2.x and Splunk Cloud Platform ...

Step into “Hunt the Insider: An Splunk ES Premier Mystery” to catch a cybercriminal ...

After a whole week of being on call, you fell asleep on your keyboard, and you hit a sequence of buttons that ...