Inno S3 Streaming Add-on for AWS S3

Splunk Community

Inno S3 Streaming Add-on for AWS S3

Inno S3 Streaming Add-on for AWS S3
Inno Streaming Add-on for AWS S3 lets a Splunk administrator deploy a serverless ingestion pipeline into their own AWS account directly from the Splunk UI — no AWS console, no aws CLI, and no Heavy Forwarder required. The problem: getting S3 data into Splunk usually means standing up and maintaining polling-based inputs or Heavy Forwarders, granting broad AWS access, and paying for idle infrastructure. This add-on replaces that with an event-driven, in-account design. How it works: you enter your AWS credentials (stored encrypted in Splunk), your HEC endpoint, target index, and S3 bucket, then click Deploy. Using the AWS API (boto3), the add-on provisions a least-privilege IAM role, a compiled Go Lambda, and an S3 ObjectCreated notification. From then on, every object that lands in the bucket triggers the Lambda, which streams and gunzips the object and forwards the records to your Splunk HEC endpoint in real time. Data flows S3 → Lambda → HEC entirely inside your AWS account; it never passes through the vendor. Highlights: - Deploy from the Splunk UI in minutes; idempotent re-deploys. - Event-driven and serverless — the Lambda scales with your data and back to zero when idle. - Runs on Search Heads of Splunk Cloud and Splunk Enterprise / Heavy Forwarder. - AWS keys are only needed at deploy time and are auto-wiped after a successful deploy; the Lambda runs on its own IAM role. - Compiled Go Lambda binary, corporate-proxy support, and an air-gapped export option. - Handles gzip (.gz) and uncompressed, newline-delimited data (NDJSON/JSON Lines and plain-text logs such as syslog, CSV, key=value). Ideal for CloudTrail, VPC Flow Logs, GuardDuty, ALB/CloudFront access logs, and Kinesis Firehose delivery. The add-on is free to install; deploying the Lambda requires a license key. See detailed performance-benchmark results (measured S3-to-HEC throughput and tuning), step-by-step usage guides, and full documentation at https://innosw.net — and purchase your license there: - 11 USD / month - 110 USD / year Get the details and your license key at https://innosw.net.
0 topics and 0 replies mentioned Inno S3 Streaming Add-on for AWS S3 in
Latest Topics
No posts to display.
Latest Replies
No posts to display.
Top Topics
No posts to display.
My Topics
No posts to display.