Getting Data In

When indexing historic and real time data together, does Splunk index old data first and new data last or vice versa?

ankithreddy777
Contributor

I have to index the historic data along with real time data from the log file. May I know from which point the indexing starts; whether it starts ingesting old data first and latest data at the end, or vice versa? .

0 Karma
1 Solution

bshuler_splunk
Splunk Employee
Splunk Employee

When indexing a file, it indexes line by line, starting with the beginning, and ending with the end of file.

View solution in original post

bshuler_splunk
Splunk Employee
Splunk Employee

When indexing a file, it indexes line by line, starting with the beginning, and ending with the end of file.

ankithreddy777
Contributor

thank you, Suppose the UF is restarted ,May I know how Splunk remember the line where it got stopped previously to start ingestion from that point. If not will it start ingestion again from the beggining of the file?

0 Karma

bshuler_splunk
Splunk Employee
Splunk Employee

There is a "magic" index called fishbucket. All of the pointers for remembering the last location for files are in it. Splunk does not forget and reindex.

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...