Getting Data In

Multiple Indexes, single S3 Bucket with SQS

megabit
New Member

Given a Splunk environment with SQS (S3) as the data source, is it possible to "filter" messages at  so that we can separate each file (based on its prefix) to different Splunk indexes?

Put another way, if we have 25 indexes, corresponding to 25 different data types in an S3 bucket, and we want to use S3 and SQS, can we configure Splunk to conditionally index the data based on a path/prefix match pattern applied to each SQS message?

 

Labels (1)
Tags (2)
0 Karma
Get Updates on the Splunk Community!

Your Guide to Splunk Digital Experience Monitoring

A flawless digital experience isn't just an advantage, it's key to customer loyalty and business success. But ...

Data Management Digest – November 2025

  Welcome to the inaugural edition of Data Management Digest! As your trusted partner in data innovation, the ...

Upcoming Webinar: Unmasking Insider Threats with Slunk Enterprise Security’s UEBA

Join us on Wed, Dec 10. at 10AM PST / 1PM EST for a live webinar and demo with Splunk experts! Discover how ...