Dashboards & Visualizations

Have to capture "environment" : "uat" from this raw data to make a pie chart?

aarun
Engager

[02-23 13:55:00] INFO LoggerMessageProcessor [[MuleRuntime].uber.31: [emea-order-mgmt-sys-uat].postOrderMgmtSysFlow.CPU_INTENSIVE @3473fb44]: { "externalTrackingId": "567", "globalTransactionId": "cd535f86-38d4-4f1c-9d1f-e18bc745df21", "muleTransactionId": "c2d3f7f9-1743-4bde-931d-ac59987bb42e", "applicationName": "emea-order-mgmt-sys-uat", "httpMethod": "POST", "processName": "postOrderMgmtSysFlow", "environment": "uat", "src": "dummy_src", "target": "TargetSystemName", "milestoneStatus": "SuccessResponseReturned", "targetResponseTime": 0, "muleProcessingTime": 13}Collapsedate_hour = 13date_mday = 23date_minute = 55date_month = februarydate_second = 0date_wday = thursdaydate_year = 2023date_zone = localhost = http-inputs-olympus-eu.splunkcloud.comindex = mulesoft-emea-dev-demolinecount = 14punct = [-_::]____[[]..:_[----].._@]:_{__"":_"",__"":_"---source = http:mulesoftsourcetype = log4jsplunk_server = idx-i-01f4e4672afe12c83.olympus-eu.splunkcloud.comtimeendpos = 15timestartpos = 1

Labels (1)
0 Karma
1 Solution

bowesmana
SplunkTrust
SplunkTrust

Use

| rex "environment\"\s?:\s?\"(?<environment>[^\"]*)"

will give you an environment field

View solution in original post

0 Karma

bowesmana
SplunkTrust
SplunkTrust

Use

| rex "environment\"\s?:\s?\"(?<environment>[^\"]*)"

will give you an environment field

0 Karma

aarun
Engager

Thanks it worked. can you please help with another field from the same data "muleProcessingTime": 13

Tags (1)
0 Karma

bowesmana
SplunkTrust
SplunkTrust

That's very similar, but it is not a quoted field, so 

| rex "muleProcessingTime\"\s?:\s?(?<muleProcessingTime>\d+)"

However, it looks like you have JSON object nested inside that raw log message. Are any fields being automatically extracted? Maybe the JSON payload is already there as a field. If not you can do this

| rex ".*?(?<json>\{.*\})"
| spath input=json

which will take everything between the first and last {} and extract all the fields using spath from it. Then all the fields will be extracted to their own field names automatically.

0 Karma

aarun
Engager

@bowesmana  

| rex "muleProcessingTime\"\s?:\s?(?<muleProcessingTime>\d+)"

This one i tried, not capturing the field. have to capture muleProcessingTime from that raw data. based on the captured 2 fields trying to make a chart

0 Karma

bowesmana
SplunkTrust
SplunkTrust

This example using your data extracts the muleProcessingTime from that data

| makeresults
| eval _raw="[02-23 13:55:00] INFO LoggerMessageProcessor [[MuleRuntime].uber.31: [emea-order-mgmt-sys-uat].postOrderMgmtSysFlow.CPU_INTENSIVE @3473fb44]: { \"externalTrackingId\": \"567\", \"globalTransactionId\": \"cd535f86-38d4-4f1c-9d1f-e18bc745df21\", \"muleTransactionId\": \"c2d3f7f9-1743-4bde-931d-ac59987bb42e\", \"applicationName\": \"emea-order-mgmt-sys-uat\", \"httpMethod\": \"POST\", \"processName\": \"postOrderMgmtSysFlow\", \"environment\": \"uat\", \"src\": \"dummy_src\", \"target\": \"TargetSystemName\", \"milestoneStatus\": \"SuccessResponseReturned\", \"targetResponseTime\": 0, \"muleProcessingTime\": 13}Collapsedate_hour = 13date_mday = 23date_minute = 55date_month = februarydate_second = 0date_wday = thursdaydate_year = 2023date_zone = localhost = http-inputs-olympus-eu.splunkcloud.comindex = mulesoft-emea-dev-demolinecount = 14punct = [-_::]____[[]..:_[----].._@]:_{__\"\":_\"\",__\"\":_\"---source = http:mulesoftsourcetype = log4jsplunk_server = idx-i-01f4e4672afe12c83.olympus-eu.splunkcloud.comtimeendpos = 15timestartpos = 1"
| rex "muleProcessingTime\"\s?:\s?(?<muleProcessingTime>\d+)"

so if it is not capturing it in your example, then there is something different with your data. Can you provide an example, for example, so

your search
| head 1
| rex "muleProcessingTime\"\s?:\s?(?<muleProcessingTime>\d+)"
| table _raw muleProcessingTime
0 Karma

aarun
Engager

@bowesmana  It's capturing but showing an error in regex100 as Your regular expression does not match the subject string. Screenshot (39).pngScreenshot (40).png

0 Karma

bowesmana
SplunkTrust
SplunkTrust

The quotes around the rex expression are not part of the match, so should not be included in the regex101 expression

0 Karma
Career Survey
First 500 qualified respondents will receive a $20 gift card! Tell us about your professional Splunk journey.

Can’t make it to .conf25? Join us online!

Get Updates on the Splunk Community!

Leveraging Automated Threat Analysis Across the Splunk Ecosystem

Are you leveraging automation to its fullest potential in your threat detection strategy?Our upcoming Security ...

Can’t Make It to Boston? Stream .conf25 and Learn with Haya Husain

Boston may be buzzing this September with Splunk University and .conf25, but you don’t have to pack a bag to ...

Splunk Lantern’s Guide to The Most Popular .conf25 Sessions

Splunk Lantern is a Splunk customer success center that provides advice from Splunk experts on valuable data ...