All Apps and Add-ons

Reading log files from Amazon S3

grahampoulter
Path Finder

We're considering Amazon Elastic Beanstalk. The application logs will get rotated to S3 buckets, so I'm asking if there is a Splunk app or other well-supported method to read logs from S3 into Splunk.

Tags (2)
1 Solution

khourihan_splun
Splunk Employee
Splunk Employee

You can try our S3 app here: http://apps.splunk.com/app/1137/

Or you can mount your S3 as a filesystem and have a Universal Forwarder monitor it like a directory. There is a good writeup here: http://www.reedmurphy.net/blog/post/splunking-through-amazon-s3-access-logs

I suggest going the s3cmd route, its a little more feature rich than the Splunk app, but I have used both with success.

View solution in original post

khourihan_splun
Splunk Employee
Splunk Employee

You can try our S3 app here: http://apps.splunk.com/app/1137/

Or you can mount your S3 as a filesystem and have a Universal Forwarder monitor it like a directory. There is a good writeup here: http://www.reedmurphy.net/blog/post/splunking-through-amazon-s3-access-logs

I suggest going the s3cmd route, its a little more feature rich than the Splunk app, but I have used both with success.

Get Updates on the Splunk Community!

Enterprise Security Content Updates (ESCU) - New Releases

In the last month, the Splunk Threat Research Team (STRT) has had 3 releases of new content via the Enterprise ...

Thought Leaders are Validating Your Hard Work and Training Rigor

As a Splunk enthusiast and member of the Splunk Community, you are one of thousands who recognize the value of ...

.conf23 Registration is Now Open!

Time to toss the .conf-etti 🎉 —  .conf23 registration is open!   Join us in Las Vegas July 17-20 for ...