Dashboards & Visualizations

Create a table metrices

dwibedi03
Explorer

I have a huge proxy logs for which need to create a monthly report since Jan 2019. Is there a way I can create the search that runs quick and I am able to create the table.

My current search 

index=xyz | timechart span=1mon count by action 

runs very slow for this huge data. I have also tried the datamodel route and yet the table is not getting created. Is there a way to create for each month and consolidate together in a optimized way?

Labels (2)
0 Karma

richgalloway
SplunkTrust
SplunkTrust

Searching a huge log will almost always take a huge amount of time.  Using a datamodel will help, but only if the datamodel is accelerated.

There are some basic steps you can take to speed up the search.

Start by qualifying the search.  Reading everything in index xyz probably is not necessary so specify the data you want, either by source, sourcetype, or some other field.

Use the fields command to reduce the number of fields Splunk has to keep track of.

Filter your data.  Once you've read events from the index, eliminate those that don't apply to your report.

Consider running the report several times over smaller time ranges (1 per quarter, perhaps).  This may not be feasible for all reports.

---
If this reply helps you, Karma would be appreciated.
0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Free Professional Services for .conf26 Attendees

This year at .conf26, we are doing something a little different. We are bringing the best minds from ...

Defend at Machine Speed: Your Guide to Security Sessions at .conf26

Splunk .conf26   With threats moving at machine speed and attack surfaces expanding across hybrid ...

Where Innovation Takes Flight: The Splunk4Aviation Flight Sim Lands at .conf26

If you hear someone at .conf26 shouting "gear down, GEAR DOWN" across the show floor, you have found us.  The ...