Getting Data In

How to ingest data Into summary index?

IRHM73
Motivator

Hi, I wonder whether someone may be able to help me with some advice please.

I'm wanting to set up a Summary Index on my Splunk environment which I'm pretty well versed at.

But my question is as follows:

Am I better pushing data into the SI at the highest level i.e. index/auditSource as shown below:

`wso2_wmf(APIRequestCompleted)` 

and then running more granular queries from this.

Or am I better pushing data into the SI with the more granular data as below and partitioning the data for each separate query, of which there will be man, but will use the same auditSource/Index combination but different auditTypes for each query, an example of which is as below.

`wso2_wmf(APIGatewayRequestCompleted)` "request.detail.apiContext"!="customer-profile" 
| timechart span=1d limit=100 count by request.detail.apiContext

Many thanks and kind regards

Chris

0 Karma

somesoni2
Revered Legend

Its a summary index search so there should be some level of summarization happening in the summary index search.

0 Karma

IRHM73
Motivator

Hi @somesoni2, thank you for the advice.

Kind Regards

Chris

0 Karma

adonio
Ultra Champion

can you kindly elaborate?
what does your macro do? can you share the full search?
what is the purpose of SI and what is the desired outcome?

0 Karma

IRHM73
Motivator

Hi @adonio, thank you for coming back to me with this and I'm sorry I wasn't able to reply immediately.

The macro we use, combines the index, auditSouce and auditType and in terms of elaborating on the search there are only a few more request.detail.apiContext' in addition to what you see.

The reason for using the SI is so users can run long range searches more efficiently.

I hope this helps.

Many thanks and kind regards

Chris

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Deep Dive: Accelerate threat investigation with Splunk’s AI Assistant in Security

AI is one of the biggest topics in the market today, and for security teams, its value goes far beyond the ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Detection Engineering Office Hours: Real-World Troubleshooting & Q&A

[REGISTER HERE] This thread is for the Community Office Hours session on Detection Engineering Office Hours: ...