Getting Data In

When indexing historic and real time data together, does Splunk index old data first and new data last or vice versa?

ankithreddy777
Contributor

I have to index the historic data along with real time data from the log file. May I know from which point the indexing starts; whether it starts ingesting old data first and latest data at the end, or vice versa? .

0 Karma
1 Solution

bshuler_splunk
Splunk Employee
Splunk Employee

When indexing a file, it indexes line by line, starting with the beginning, and ending with the end of file.

View solution in original post

bshuler_splunk
Splunk Employee
Splunk Employee

When indexing a file, it indexes line by line, starting with the beginning, and ending with the end of file.

ankithreddy777
Contributor

thank you, Suppose the UF is restarted ,May I know how Splunk remember the line where it got stopped previously to start ingestion from that point. If not will it start ingestion again from the beggining of the file?

0 Karma

bshuler_splunk
Splunk Employee
Splunk Employee

There is a "magic" index called fishbucket. All of the pointers for remembering the last location for files are in it. Splunk does not forget and reindex.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...