Getting Data In

Speed up Search while

splumtk1
New Member

Hi Currently I have some JSON files in this structure :
{
{ Meta: .... }
{ Data: A,
B: [ {key: value_b1}, {key:value_b2} ... ]
}
In order to show the nested data properly, the JSON is transformed such each nested data is given individual Meta tags:
{
{ Meta: .... }
{ Data: B: {key:value_b1} }
}
{
{ Meta: .... }
{ Data: B: {key:value_b2} }
}
But this resulted in around 200,000 events per JSON file which slows down the dashboard searches, may I know what will be a good way to keep it to 1 events per JSON file while retaining the nested data structures?

Thank you

Tags (2)
0 Karma

niketn
Legend

@splumtk1, if this is JSON data have you turned on INDEXED_EXTRACTION=json? If so are you using tstats in the query?

____________________________________________
| makeresults | eval message= "Happy Splunking!!!"
0 Karma

to4kawa
Ultra Champion

the dashboard searches
what do you search?

to keep it to 1 events per JSON file while retaining the nested data structures?
I'm not sure what you say.
Statistics OR Events ?

If your JSON is valid, | spath is useful.
but But this resulted in around 200,000 events per JSON file
your query is not good, maybe.

0 Karma
Get Updates on the Splunk Community!

Automatic Discovery Part 1: What is Automatic Discovery in Splunk Observability Cloud ...

If you’ve ever deployed a new database cluster, spun up a caching layer, or added a load balancer, you know it ...

Real-Time Fraud Detection: How Splunk Dashboards Protect Financial Institutions

Financial fraud isn't slowing down. If anything, it's getting more sophisticated. Account takeovers, credit ...

Splunk + ThousandEyes: Correlate frontend, app, and network data to troubleshoot ...

 Are you tired of troubleshooting delays caused by siloed frontend, application, and network data? We've got a ...