Hi,
We are trying to integrate gmail logs into our Splunk Cloud instance. We have tried the 'Splunk Addon for Google Workspace(https://splunkbase.splunk.com/app/5556/)'. The integration was smooth, and we were able to see gsuite header logs in Splunk. But the problem in this case was it eventually generated large bills from Google for the bigqueries. Hence we were forced to disable it temporarily. When we did an analysis, we found that the current approach in this addon is to query all partition at once using the below query: "SELECT * FROM `{gcp_project_id}.gmail_logs_dataset.daily_*` " "WHERE event_info.timestamp_usec > {start_time_usec} " "AND event_info.timestamp_usec < {end_time_usec} " "ORDER BY event_info.timestamp_usec ASC" Instead of querying the whole partition, we would like to query the table of each day, it would massively reduce the cost. I did raise a support ticket with Splunk on this, and they have confirmed it requires a code change and they cannot assure any timeline for this. Even though we tried to manually edit this part of code and upload it via custom app, it didnt succeed the vetting process. It would be really helpful if someone could provide me an alternate solution for integrating gmail logs or a way to upload the modified addon. Much appreciated,
Archa
... View more