Splunk Search

Splunk add-on for AWS: In a generic S3 input, can a key-prefix contain a wildcard?

travislelledeep
Explorer

Trying to use a key-prefix when setting up a Generic S3 input that utilizes a wildcard in the path, but it doesn't look to be working.

S3 key prefix = /AWSLogs/*/vpcflowlogs/

Has anyone had any luck in setting this up before?

ColinJacksonPS
Path Finder

I'm trying to do the same thing. Anyone hear anything? 

0 Karma

travislelledeep
Explorer

Also to clarify - since it doesn't appear I can edit my post - this was setup via the GUI, so ignore the inputs.conf-like formatting of my example, since this wasn't setup in a .conf file, I was just representing what I used for my S3 key prefix.

0 Karma

mpresseau
New Member

Did you resolve this? I have a similar issue trying to find the proper format for this field. Not sure if prefix means part of a file, or the folder within a bucket to be looking at....

I have logs/ in that field, thinking that it is grabbing that folder but it is pulling hundreds of GB from S3, even though there are only 2GB worth of compressed log files in that folder...

Hope you found something?

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Enhance Security Operations with Automated Threat Analysis in the Splunk EcosystemAre you leveraging ...

What Is Splunk? Here’s What You Can Do with Splunk

Hey Splunk Community, we know you know Splunk. You likely leverage its unparalleled ability to ingest, index, ...

Level Up Your .conf25: Splunk Arcade Comes to Boston

With .conf25 right around the corner in Boston, there’s a lot to look forward to — inspiring keynotes, ...