All Apps and Add-ons

AWS Cloudtrail to Cribl. Cribl to Splunk HEC. AWS Add On Setup.

xbones84
New Member

So we are in a test environment. We have cloudtrail logs being generated from a Datagen source in Cribl. Those logs are being shipped to a Splunk Index Cluster via HEC (load balanced in Cribl to balance between the members). I have appended the field/value pair of sourceType/aws:cloudtrail and configured the HEC for the cluster inputs.conf to have the sourcetype of aws:cloudtrail. It appears as though my logs are not being indexed into the CIM format. One indicator is I think eventTtype: AwsApiCall should be event_type: AwsApiCall after going through the AWS add on. I have the add-on pushed to the cluster via the manager-apps and it shows up through the peer-apps on the indexers. Is there anything else I need to setup?

Labels (2)
0 Karma

sainag_splunk
Splunk Employee
Splunk Employee

@xbones84 Hi! Since you're using HEC event endpoint.? (/services/collector/event), the sourcetype and metadata are already set when the data reaches Splunk. The AWS Add-on's props.conf configurations don't get applied to HEC event endpoint data because the metadata is predetermined in your JSON payload.

The AWS Add-on assumes data will flow through its inputs where it can apply parsing-time transformations. With HEC event endpoint, you bypass that processing, so you need to handle CIM compliance upstream (in Cribl) or with custom Splunk configurations. 

If this helps, Upvote!!!!
Together we make the Splunk Community stronger 
0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.
Get Updates on the Splunk Community!

Tech Talk Recap | Mastering Threat Hunting

Mastering Threat HuntingDive into the world of threat hunting, exploring the key differences between ...

Observability for AI Applications: Troubleshooting Latency

If you’re working with proprietary company data, you’re probably going to have a locally hosted LLM or many ...

Splunk AI Assistant for SPL vs. ChatGPT: Which One is Better?

In the age of AI, every tool promises to make our lives easier. From summarizing content to writing code, ...