Getting Data In

How to delete indexed data from disk?

vtrend
Engager

I have an index = 'telemetry' which gets data from a local directory on standalone Splunk installation.

I deleted some data from above index which came in from particular directory using command

index='telemetry'  source="/data/01/*" | delete

The above index has still more data from other sources (e.g. "/data/02" ..)

I want to re-index the data from deleted directory i.e. "/data/01" again.
Running splunk clean eventdata involves deleting entire index.

I want to wipe from disk only that part of data that has been deleted above so that I can re-index it back. How can I achieve this?

 

Labels (2)
0 Karma

vtrend
Engager

@venkatasri  Thanks Venkat for helping me out.

I tested by re-ingesting same data but Splunk is not indexing it back, the job runs, but no results. Searching around the forums, few users mentioned I need to either clean the index or delete fishbuckets etc which I was trying to avoid.

0 Karma

venkatasri
SplunkTrust
SplunkTrust

@vtrend 

How are you re-ingesting the data from same source?

0 Karma

vtrend
Engager

Yes, I have added local data directory with the path "/data/01/" and "Indexed Once' again.
I chose same Index and App Context while re-ingesting.

However when I submit and complete above steps, the search query gives 0 results.

index='telemetry' source='/data/01/*'

0 Karma

venkatasri
SplunkTrust
SplunkTrust

@vtrend If you are using the same forwarder to re-index fishbucket ignores re-reading the same file contents.

Try clearing the fishbucket to specific source, replace - "/var/log/messages" with your source path

./splunk cmd btprobe -d  /opt/splunkforwarder/var/lib/splunk/fishbucket/splunk_private_db  --file /var/log/messages --reset

 

vtrend
Engager

@venkatasri 

Ohh, this explains it. I'll try this and update here with the results.

Thanks a lot.

0 Karma

venkatasri
SplunkTrust
SplunkTrust

Hi @vtrend 

There is no other command except clean to wipe out data from disk however as you said it will do whole index not a particular source.

| delete  command is something you already did meaning you won't be able to search it again but data exist on disk. When you re-ingest data from same source that you have deleted newly ingested will be searchable without issues.

-- 

Hope this helps!

Tags (2)
0 Karma
Get Updates on the Splunk Community!

Dashboards: Hiding charts while search is being executed and other uses for tokens

There are a couple of features of SimpleXML / Classic dashboards that can be used to enhance the user ...

Splunk Observability Cloud's AI Assistant in Action Series: Explaining Metrics and ...

This is the fourth post in the Splunk Observability Cloud’s AI Assistant in Action series that digs into how ...

Brains, Bytes, and Boston: Learn from the Best at .conf25

When you think of Boston, you might picture colonial charm, world-class universities, or even the crack of a ...