How to poll messages from AWS SQS to Splunk?

[abovebeyond]

Hi, one of our services is sending messages to AWS SQS , how can i poll them to Splunk?

Thanks

[bmacias84 · Accepted solution]

Hello,

Try AWS SQS Poller. Its an app I built which I currently use in production.

[abovebeyond]

Thanks , SQS Poller is better !

[hchinta]

@bmacias84- SQS Poller app stopped working after the upgrade of Splunk to 6.6.5

ERROR ExecProcessor - message from "/opt/splunk/etc/apps/sqs_poller/bin/sqs_poller.sh" Modular input Invalid arguments to modular input script: /opt/splunk/bin/node,/opt/splunk/etc/apps/sqs_poller/bin/app/sqs_poller.js

[bmacias84]

This Add-on has been superseded by AWS Add-on created by Splunk since they add this functionality. AWS SQS Poller latest version compatibility is 6.3.x.

[hchinta]

ok Thanks!

[javiergn]

Hi,

Take a look at this: http://docs.splunk.com/Documentation/AddOns/latest/AWS/ConfigureAWS

Configure AWS Config

The Splunk Add-on for AWS collects events from a Simple Queue Service (SQS) that subscribes to the Simple Notification Service (SNS) notification events from AWS Config. Configure AWS Config to produce these notifications, then create the SQS for the app to access them.

1. Enable Config by following the AWS Config setup guide: http://docs.aws.amazon.com/config/latest/developerguide/setting-up.html.

2. Follow the AWS Config Getting Started guide (http://docs.aws.amazon.com/config/latest/developerguide/getting-started.html) to specify an S3 bucket to save the data and an SNS topic to stream Config notifications to. Do not use an existing bucket or SNS. Following the AWS Config setup allows AWS to automatically create the IAM role for AWS config so that it has the necessary permissions for the bucket and SNS.

Note: Do not use periods in your S3 bucket name. Using periods in bucket names causes an AWS certificate validation issue. For more information, see http://docs.aws.amazon.com/AmazonS3/latest/dev/VirtualHosting.html.

3. Finish the setup steps in the AWS Config Getting Started guide and verify that you have successfully completed the setup process. If you used the AWS console, you should see the Resource Lookup page. If you use the CLI, you can follow this verification guide: http://docs.aws.amazon.com/config/latest/developerguide/gs-cli-verify-subscribe.html.

4. Create a new SQS.

5. Subscribe the SQS exclusively to the the SNS Topic that you created in Step 2.

6. Grant IAM permissions to access the S3 bucket and SQS to the AWS account that the app uses to connect to your AWS environment. See "Configure AWS permissions" for details.