Getting Data In

Speed up Search while

splumtk1
New Member

Hi Currently I have some JSON files in this structure :
{
{ Meta: .... }
{ Data: A,
B: [ {key: value_b1}, {key:value_b2} ... ]
}
In order to show the nested data properly, the JSON is transformed such each nested data is given individual Meta tags:
{
{ Meta: .... }
{ Data: B: {key:value_b1} }
}
{
{ Meta: .... }
{ Data: B: {key:value_b2} }
}
But this resulted in around 200,000 events per JSON file which slows down the dashboard searches, may I know what will be a good way to keep it to 1 events per JSON file while retaining the nested data structures?

Thank you

Tags (2)
0 Karma

niketn
Legend

@splumtk1, if this is JSON data have you turned on INDEXED_EXTRACTION=json? If so are you using tstats in the query?

____________________________________________
| makeresults | eval message= "Happy Splunking!!!"
0 Karma

to4kawa
Ultra Champion

the dashboard searches
what do you search?

to keep it to 1 events per JSON file while retaining the nested data structures?
I'm not sure what you say.
Statistics OR Events ?

If your JSON is valid, | spath is useful.
but But this resulted in around 200,000 events per JSON file
your query is not good, maybe.

0 Karma
Get Updates on the Splunk Community!

Splunk MCP & Agentic AI: Machine Data Without Limits

  Discover how the Splunk Model Context Protocol (MCP) Server can revolutionize the way your organization ...

Finding Based Detections General Availability

Overview  We’ve come a long way, folks, but here in Enterprise Security 8.4 I’m happy to announce Finding ...

Get Your Hands Dirty (and Your Shoes Comfy): The Splunk Experience

Hands-On Learning and Technical Seminars  Sometimes, you just need to see the code. For those looking for a ...