Getting Data In

Events from a log were not breaking properly so I edited props.conf to fix the issue, but is it possible to reindex the old data to ensure proper event breaking?

ankithreddy777
Contributor

I have ingested the data from a log file but the events were not breaking properly. So I edited the props.conf file to fix the issue.

The issue is fixed and current events are breaking properly. But how do I deal with old data which is already ingested with uneven event breaking? I have a limitation that my indexer should not be restarted since it is live.

0 Karma

aaraneta_splunk
Splunk Employee
Splunk Employee

Hi @ankithreddy777 - I got a notification that you accepted the answer by rjthibod but then I saw this post and it was unaccepted. Did you accidentally unaccept the answer?

0 Karma

rjthibod
Champion

In my opinion, the easiest approach to reindex the data without touching the forwarder or internals of the indexer are to do as follows. Note this will require 'delete' capability on your user and will count against your data volume license for the day

  • write an SPL search to find the data for the time period before you fixed the settings
  • from the search export the old data in its raw form to a file on your local machine
  • delete the old data by adding | delete to the end of the query used to export the data in the previous step
  • go to "Settings" -> "Add Data" -> "Upload" -> select your file -> and then follow the prompts to set the proper sourcetype and index
0 Karma

thejeffreystone
Path Finder

I typically leave it since going forward all the data is right. But I guess it depends on how long it was not breaking properly. I have never done it but I believe you could delete the data in your index, delete the fishbucket on your universal forwarder, and just reingest the data. If it is a lot of data then that might be intensive.

0 Karma

thejeffreystone
Path Finder
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...