Knowledge Management

Summary Index Backfill - Skipped

rodrigorsilva
Communicator

Hello
I have a scheduled search that populates a summary index. I would like to backfill that summary index for the last 1 day.

When I run this command:

./splunk cmd python fill_summary_index.py -app test_app -name "Report - test" -et -1d@d -lt @d -j 1 -dedup true -nolocal true -auth admin:xxxxx -index sum_test -showprogress true

I get a message:

"Out of 1 scheduled times, 1 will be skipped because they already exist"

Thanks for the tips!

Rodrigo Ribeiro

0 Karma

somesoni2
Revered Legend

It seems like some data is available for the time period you want to backfill. Did the regular schedule of your summary index ran already (and it might have some missing data that you want to backfill)? The flag -dedup will skip the backfill execution if the summary index data for the same period already exist. See Note on following Doc page: https://docs.splunk.com/Documentation/Splunk/7.1.1/Knowledge/Managesummaryindexgapsandoverlaps#Use_t...

0 Karma

rodrigorsilva
Communicator

Thanks somesoni2,

Exactly, I have a JOB that runs "yesterday" every day, but because an error in a search during execution:

"Unknown error for peer server_splunk003. Search Results might be incomplete. If this occurs frequently, please check on the peer"

I have this situation, example:
My JOB scheduled returned 300;
My query ad-hoc in the same period returned 400;

This occurs because a error message, i need to reprocess this difference and add data in summary index...

0 Karma

somesoni2
Revered Legend

Easiest way would be to just delete that incomplete data for yesterday and then run backfill.

0 Karma

rodrigorsilva
Communicator

Maybe my understanding is wrong, this script can be used only in the period i dont have data... That's it?
I thought this script to do a difference too and add fault data, but that does not seem to be the purpose, correct?

Tks,

Rodrigo Ribeiro

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Unlock What’s Next: The Splunk Cloud Platform at .conf25

In just a few days, Boston will be buzzing as the Splunk team and thousands of community members come together ...