Splunk Search

extra data from particular filed and show in chart

dyapasrikanth
Path Finder

I have logs like 

{"message": "Submitted amount category1: 213, category2: 543.56, category3: 4343.00", "specialCustomer": "true"}

I am trying to extract sum of amount by each category and customerType. My query is like this

 

 

| search message="Submitted amount *"
| rex field=message "(?<category>\w+): (?<amount>\d*\.?\d*)"
| eval userType=if(isnotnull(specialCustomer), "Special", "Normal")
| chart sum(amount) as Amount by userType, category
| addtotals
| eval category=case(
category="category1", "Category 1", 
category="category2", "Category 2",
category="category3", "Category 3")

 

 

However I am getting only one category data, what is wrong with my regex? do I need to use extract for this?

Labels (3)
0 Karma
1 Solution

scelikok
SplunkTrust
SplunkTrust

Hi @dyapasrikanth,

rex command stops on the first match as default. You should use max_match option;

| search message="Submitted amount *" 
| rex field=message max_match=0 "(?<category>\w+): (?<amount>\d*\.?\d*)" 
| eval userType=if(isnotnull(specialCustomer), "Special", "Normal") 
| chart sum(amount) as Amount by userType, category 
| addtotals 
| eval category=case(
    category="category1", "Category 1", 
    category="category2", "Category 2",
    category="category3", "Category 3")
If this reply helps you an upvote and "Accept as Solution" is appreciated.

View solution in original post

0 Karma

scelikok
SplunkTrust
SplunkTrust

Hi @dyapasrikanth,

rex command stops on the first match as default. You should use max_match option;

| search message="Submitted amount *" 
| rex field=message max_match=0 "(?<category>\w+): (?<amount>\d*\.?\d*)" 
| eval userType=if(isnotnull(specialCustomer), "Special", "Normal") 
| chart sum(amount) as Amount by userType, category 
| addtotals 
| eval category=case(
    category="category1", "Category 1", 
    category="category2", "Category 2",
    category="category3", "Category 3")
If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma

dyapasrikanth
Path Finder

I got it finally with mvzip & mvexpand, not sure it is a best solution

 

| rex field=message max_match=0 "(?<category>\w+):\s(?<amount>\d*\.?\d*)"
| eval temp = mvzip(category,amount, "#")
| mvexpand temp
| rex field=temp "(?<category>.+)#(?<amount>.+)"
| eval category=case(
    category="category1", "Category 1", 
    category="category2", "Category 2",
    category="category3", "Category 3")
| chart sum(amount) as Amount by userType, category
| addtotals

 

  

 
0 Karma

dyapasrikanth
Path Finder

Thanks for your quick reply, yes that max_match=0 did the trick. But why my sum is going wrong ? 
For all categories it is giving first category amount only.

If I table it, they are coming as group instead in each row.

Tags (1)
0 Karma
Get Updates on the Splunk Community!

Splunk Enterprise Security: Your Command Center for PCI DSS Compliance

Every security professional knows the drill. The PCI DSS audit is approaching, and suddenly everyone's asking ...

Developer Spotlight with Guilhem Marchand

From Splunk Engineer to Founder: The Journey Behind TrackMe    After spending over 12 years working full time ...

Cisco Catalyst Center Meets Splunk ITSI: From 'Payments Are Down' to Root Cause in ...

The Problem: When Networks and Services Don't Talk Payment systems fail at a retail location. Customers are ...