All Apps and Add-ons

Splunk Add-on for Amazon Web Services: How to configure sync frequency of newly created EC2 instances?

Explorer

Where can I configure the frequency in which Splunk will sync newly created EC2 instances? F.Y.I Using the Splunk Add-on for Amazon Web Services.

0 Karma

Splunk Employee
Splunk Employee

There is an "interval" parameter in all modular input in Addon. You can see it from input setup dialog.

0 Karma

Explorer

I set the "interval" param for [awscloudwatch:...] stanza under SplunkTA_aws/local/inputs.conf. Not sure if this is the same interval param you speak of.

0 Karma

Splunk Employee
Splunk Employee

For cloudwatch input, there are two parameters related.
1. period: what's the interval of AWS log the data
2. polling_interval: the interval splunk consume the data

The polling_interval should be a multiplier of period.

0 Karma

Explorer

Both these are set to 300. However newly created EC2 instances take quite some time to show up in Splunk, upwards of hours. Based on my inputs.conf, they should show up in minutes.

[aws_cloudwatch://************]
aws_account = ***********
aws_region = us-west-1,us-west-2,us-east-1
index = main
metric_dimensions = [{"InstanceId": [".*"]}]
metric_names = ["CPUCreditBalance", "CPUCreditUsage", "CPUUtilization", "StatusCheckFailed_Instance"]
metric_namespace = AWS/EC2
period = 300
polling_interval = 300
sourcetype = aws:cloudwatch
statistics = ["Minimum", "Maximum", "Sum", "Average"]
0 Karma