Splunk Search

Table view in dashboard

venkat0896
Path Finder

Hi

i am trying to create a Dashboard. i need some assistance on creating a table format.
i have some executions like
1. XXX All rules has been executed in 1068 ms.
2. YYY All rules has been executed in 900 ms.
3. ZZZ All rules has been executed in 1300 ms.

i want to view this as a table with total count of occurrence and Average response time
the table should look like

Request Count Avg response time
XXX 1 1068 ms
YYY 1 900 ms
ZZZ 1 1300 ms

Please help on this. thanks in advance !

Tags (2)
0 Karma
1 Solution

ansusabu
Communicator

@venkat0896 If the logs always follow the below pattern
2019-08-20 13:55:47,054 INFO package name XXX All rules has been executed in 540 ms
(date),ddd INFO package name XXX All rules has been executed in 540 ms

then you can use the following regex,include '\)\s' at the start of regex which richgalloway has mentioned and use the same query

View solution in original post

0 Karma

ansusabu
Communicator

@venkat0896 If the logs always follow the below pattern
2019-08-20 13:55:47,054 INFO package name XXX All rules has been executed in 540 ms
(date),ddd INFO package name XXX All rules has been executed in 540 ms

then you can use the following regex,include '\)\s' at the start of regex which richgalloway has mentioned and use the same query

0 Karma

ansusabu
Communicator
... | rex "\)\s(?<Request>\w+).*?in (?<ms>\d+)" 
 | stats count as Count avg(ms) as "Avg response time" by Request
 | table Request Count "Avg response time"

venkat0896
Path Finder

@ansusabu Thanks it worked 🙂 🙂

0 Karma

richgalloway
SplunkTrust
SplunkTrust

This should get you started.

... | rex "(?<Request>\w+).*?in (?<ms>\d+)" 
| stats count as Count avg(ms) as "Avg response time" by Request
| table Request Count "Avg response time"
---
If this reply helps you, Karma would be appreciated.

venkat0896
Path Finder

@richgalloway
I am getting validation issues "unexpected close tag"
please take a look at my query tag
source="/server.log"
"All rules has been executed in"
| rex "(?\w+).*?in (?\d+)"
| stats count as Count, avg(ms) as "Avg response time" by Request

any suggestions ? thanks in advance !!

0 Karma

ansusabu
Communicator

it is rex field='fieldname'(regex)

0 Karma

Sukisen1981
Champion

hi @venkat0896
I think your format got corrupted while pasting as a comment, which happens.
@richgalloway 's rex is correct and giving the right output, do you see any issues with using his rex?

0 Karma

venkat0896
Path Finder

@richgalloway @Sukisen1981
yes looks like the format got corrupted. now i did used the query in search command but the output is not what i was expecting.
My expected format:
Request Count Avg response time
XXX 1 1068 ms
YYY 1 900 ms
ZZZ 1 1300 ms

but was:
Request Count Avg response time
2019 29 169.13793103448276

whats actually happening is the query which you provided is giving the overall count and average response time.
basically i am using 3 different services i want the result to be displayed individually for each service instead of as a whole.
Secondly this query is not appending the service name.
this is my logger
2019-08-20 13:55:47,054 INFO package name XXX All rules has been executed in 540 ms
expected
Request Count Average response
XXX 1 540 ms

but in request it is appending as 2019 as it is picking the first word from the sentence.
appreciate your help on this. thanks

0 Karma

ansusabu
Communicator

The problem was with the regex, since the log format which you gave was like: XXX All rules has been executed in 1068 ms.

Try using the regex for '2019-08-20 13:55:47,054 INFO package name XXX All rules has been executed in 540 ms'
\)\s(?\w+).*?in (?\d+)

"""... | rex "\)\s(?\w+).*?in (?\d+)"
| stats count as Count avg(ms) as "Avg response time" by request
| table request Count "Avg response time""""

0 Karma

venkat0896
Path Finder

@ansusabu
Since my code calls multiple services over period of time the time stamp keeps changing. the above mentioned way might work only for the explicitly given time in the expression

0 Karma
Get Updates on the Splunk Community!

Observability Highlights | January 2023 Newsletter

 January 2023New Product Releases Splunk Network Explorer for Infrastructure MonitoringSplunk unveils Network ...

Security Highlights | January 2023 Newsletter

January 2023 Splunk Security Essentials (SSE) 3.7.0 ReleaseThe free Splunk Security Essentials (SSE) 3.7.0 app ...

Platform Highlights | January 2023 Newsletter

 January 2023Peace on Earth and Peace of Mind With Business ResilienceAll organizations can start the new year ...