All Apps and Add-ons

Splunk Add-on for Amazon Web Services: How to configure sync frequency of newly created EC2 instances?

specora
Explorer

Where can I configure the frequency in which Splunk will sync newly created EC2 instances? F.Y.I Using the Splunk Add-on for Amazon Web Services.

0 Karma

pchen_splunk
Splunk Employee
Splunk Employee

There is an "interval" parameter in all modular input in Addon. You can see it from input setup dialog.

0 Karma

specora
Explorer

I set the "interval" param for [aws_cloudwatch:...] stanza under Splunk_TA_aws/local/inputs.conf. Not sure if this is the same interval param you speak of.

0 Karma

pchen_splunk
Splunk Employee
Splunk Employee

For cloudwatch input, there are two parameters related.
1. period: what's the interval of AWS log the data
2. polling_interval: the interval splunk consume the data

The polling_interval should be a multiplier of period.

0 Karma

specora
Explorer

Both these are set to 300. However newly created EC2 instances take quite some time to show up in Splunk, upwards of hours. Based on my inputs.conf, they should show up in minutes.

[aws_cloudwatch://************]
aws_account = ***********
aws_region = us-west-1,us-west-2,us-east-1
index = main
metric_dimensions = [{"InstanceId": [".*"]}]
metric_names = ["CPUCreditBalance", "CPUCreditUsage", "CPUUtilization", "StatusCheckFailed_Instance"]
metric_namespace = AWS/EC2
period = 300
polling_interval = 300
sourcetype = aws:cloudwatch
statistics = ["Minimum", "Maximum", "Sum", "Average"]
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

A Four-Part Event Series: Full Stack Observability For the AI Era

As AI reshapes applications, infrastructure, and the way teams operate, the traditional boundaries of ...

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Event Series: Level up your SOC: Advancing with Splunk Enterprise Security

AI has fundamentally raised the stakes for security operations, and this three-part series is your guide to ...