Getting Data In

Speed up Search while

splumtk1
New Member

Hi Currently I have some JSON files in this structure :
{
{ Meta: .... }
{ Data: A,
B: [ {key: value_b1}, {key:value_b2} ... ]
}
In order to show the nested data properly, the JSON is transformed such each nested data is given individual Meta tags:
{
{ Meta: .... }
{ Data: B: {key:value_b1} }
}
{
{ Meta: .... }
{ Data: B: {key:value_b2} }
}
But this resulted in around 200,000 events per JSON file which slows down the dashboard searches, may I know what will be a good way to keep it to 1 events per JSON file while retaining the nested data structures?

Thank you

Tags (2)
0 Karma

niketn
Legend

@splumtk1, if this is JSON data have you turned on INDEXED_EXTRACTION=json? If so are you using tstats in the query?

____________________________________________
| makeresults | eval message= "Happy Splunking!!!"
0 Karma

to4kawa
Ultra Champion

the dashboard searches
what do you search?

to keep it to 1 events per JSON file while retaining the nested data structures?
I'm not sure what you say.
Statistics OR Events ?

If your JSON is valid, | spath is useful.
but But this resulted in around 200,000 events per JSON file
your query is not good, maybe.

0 Karma
Get Updates on the Splunk Community!

SOC4Kafka - New Kafka Connector Powered by OpenTelemetry

The new SOC4Kafka connector, built on OpenTelemetry, enables the collection of Kafka messages and forwards ...

Your Voice Matters! Help Us Shape the New Splunk Lantern Experience

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...

Building Momentum: Splunk Developer Program at .conf25

At Splunk, developers are at the heart of innovation. That’s why this year at .conf25, we officially launched ...