Deployment Architecture

Why is an AWS S3 Bucket with .zip Files not getting indexed in Splunk Cloud?

yoni1887
New Member

I'm a bit of a noob so any help here would be greatly appreciated.

I have buckets in S3 with .log files contained in .zip files. For some season Splunk (Splunk Cloud) isn't extracting the .zip files and indexing the contained .log files. Any ideas why this would be? When I upload one of the .log files within a .zip file individually it gets indexed beautifully. It was my understanding that Splunk should have no problem indexing files within .zip files.

Thanks in advance!

Tags (5)
0 Karma

czheng
New Member

According to Splunk doc, it just does not support .zip file on S3 bucket. Refer to the list of supported compressed file format at #4 about this:
http://docs.splunk.com/Documentation/AddOns/released/AWS/ConfigureInputs#S3_inputs

0 Karma

esix_splunk
Splunk Employee
Splunk Employee

Validate your inputs, and make sure that the .zip files are not blacklisted. Most likely they are due to processing and member requirements associated with un/archiving files in the queues.

0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...