Getting Data In

When indexing historic and real time data together, does Splunk index old data first and new data last or vice versa?

ankithreddy777
Contributor

I have to index the historic data along with real time data from the log file. May I know from which point the indexing starts; whether it starts ingesting old data first and latest data at the end, or vice versa? .

0 Karma
1 Solution

bshuler_splunk
Splunk Employee
Splunk Employee

When indexing a file, it indexes line by line, starting with the beginning, and ending with the end of file.

View solution in original post

bshuler_splunk
Splunk Employee
Splunk Employee

When indexing a file, it indexes line by line, starting with the beginning, and ending with the end of file.

ankithreddy777
Contributor

thank you, Suppose the UF is restarted ,May I know how Splunk remember the line where it got stopped previously to start ingestion from that point. If not will it start ingestion again from the beggining of the file?

0 Karma

bshuler_splunk
Splunk Employee
Splunk Employee

There is a "magic" index called fishbucket. All of the pointers for remembering the last location for files are in it. Splunk does not forget and reindex.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Where Innovation Takes Flight: The Splunk4Aviation Flight Sim Lands at .conf26

If you hear someone at .conf26 shouting "gear down, GEAR DOWN" across the show floor, you have found us.  The ...

Turn Cisco Telemetry Into Action with Cisco Data Fabric, powered by the Splunk ...

The surge in machine data is already hitting enterprise budgets, and the agentic era will only intensify it. ...

Persistent Queue at TcpOut — One of Splunk's Most Practical Features

Splunk introduced persistent queueing at the tcpout layer as one of the most practical resilience features in ...