Getting Data In

Splunk indexing zipped file without extracting or reading contents

padgetts
Observer

I am trying to make a Splunk index a zipped file that is generated every hour.

I use the batch method in order to destroy the file once it has been dealt with however i do not want Splunk to read the contents of the file but rather just index the actual zipped information for archival purposes.

Then if i require it in the future i can extract it at a later date.

 

I have looked into the props.conf (invalid_cause) method but it seems to extract the zipped file before indexing or not at all (errors).

 

Does anyone have experience or advice with this? 

Labels (3)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

That's not really what Splunk is for.  Since zipped files are not text, Splunk will not index them in native form.  After all, the point of Splunk is to have your data available for searching and a zipped file is not searchable.

Instead, consider copying the zip file to an AWS S3 bucket for archival.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Rounding off the Splunk Dashboard Contest

What does a contest-winning Splunk dashboard look like? In this case, it isn't in a browser tab at all. It ...

A Four Part Event Series: AI + Observability: AI Agents, LLMs, Apps, & Infrastructure

AI + Observability: AI Agents, LLMs, Apps, & Infrastructure The rapid evolution of artificial intelligence ...

Splunk Technical Support Is Moving to Cisco Support Tools

Introduction Splunk technical support is transitioning to Cisco’s support environment. This change brings ...