Getting Data In

How to ingest data Into summary index?

IRHM73
Motivator

Hi, I wonder whether someone may be able to help me with some advice please.

I'm wanting to set up a Summary Index on my Splunk environment which I'm pretty well versed at.

But my question is as follows:

Am I better pushing data into the SI at the highest level i.e. index/auditSource as shown below:

`wso2_wmf(APIRequestCompleted)` 

and then running more granular queries from this.

Or am I better pushing data into the SI with the more granular data as below and partitioning the data for each separate query, of which there will be man, but will use the same auditSource/Index combination but different auditTypes for each query, an example of which is as below.

`wso2_wmf(APIGatewayRequestCompleted)` "request.detail.apiContext"!="customer-profile" 
| timechart span=1d limit=100 count by request.detail.apiContext

Many thanks and kind regards

Chris

0 Karma

somesoni2
Revered Legend

Its a summary index search so there should be some level of summarization happening in the summary index search.

0 Karma

IRHM73
Motivator

Hi @somesoni2, thank you for the advice.

Kind Regards

Chris

0 Karma

adonio
Ultra Champion

can you kindly elaborate?
what does your macro do? can you share the full search?
what is the purpose of SI and what is the desired outcome?

0 Karma

IRHM73
Motivator

Hi @adonio, thank you for coming back to me with this and I'm sorry I wasn't able to reply immediately.

The macro we use, combines the index, auditSouce and auditType and in terms of elaborating on the search there are only a few more request.detail.apiContext' in addition to what you see.

The reason for using the SI is so users can run long range searches more efficiently.

I hope this helps.

Many thanks and kind regards

Chris

0 Karma
Get Updates on the Splunk Community!

Enhance Security Visibility with Splunk Enterprise Security 7.1 through Threat ...

(view in My Videos)Struggling with alert fatigue, lack of context, and prioritization around security ...

Troubleshooting the OpenTelemetry Collector

  In this tech talk, you’ll learn how to troubleshoot the OpenTelemetry collector - from checking the ...

Adoption of Infrastructure Monitoring at Splunk

  Splunk's Growth Engineering team showcases one of their first Splunk product adoption-Splunk Infrastructure ...