Splunk Enterprise Security

Getting incorrect data while I am using rex splunk

rashhvarikuti
New Member

I wrote below query to get the data and display in my dashboard. And I am getting results with correct data + getting additional data too.

Here is the query:

index=tap-prod sourcetype=prod jobId=e62-71c72ccb3aec diff
| rex field=_raw "\"diff\":(?.*)}+"
| spath input=message
| extract kvdelim=":" pairdelim="," message
| table fieldName path expValue actValue

Here is the data I am parsing:

{
  "tapName": "tapData",
  "tapUuid": "22015f427a12",
  "diff": {
    "actValue": "tap_actualValue",
    "address": "[email protected]",
    "diffType": "SAMPLE_DIFFERENCE",
    "expValue": "tap_expectedValue",
    "fieldName": "Sample",
    "fullPath": "/http://www.gmail.com/file",
    "path": "/send"
  }
}

While executing above query I am getting below results which is incorrect:

Results

(fieldName)         ( path )                       (expValue)                  (actValue)               (address)
address":[email protected]"  expValue":"tap_expectedValue   actValue":"tap_actualValue   testName":"someOtherVal  `Sample`                                                `/send`                                                 `tap_expectedValue`                          `tap_actualValue`
0 Karma

woodcock
Esteemed Legend

Like this:

| rex "(?ms)\"diff\":(?<message>.*)}+" 

As in this:

| makeresults 
| eval _raw="{
\"tapName\": \"tapData\",
\"tapUuid\": \"22015f427a12\",
\"diff\": {
\"actValue\": \"tap_actualValue\",
\"address\": \"[email protected]\",
\"diffType\": \"SAMPLE_DIFFERENCE\",
\"expValue\": \"tap_expectedValue\",
\"fieldName\": \"Sample\",
\"fullPath\": \"/http://www.gmail.com/file\",
\"path\": \"/send\"
    }
}" 
| rex "(?ms)\"diff\":(?<message>.*)}+" 
| spath input=message 
| table fieldName path expValue actValue**
0 Karma

rashhvarikuti
New Member

Thank you for your quick reply.

I tried with above solution but getting same results.

0 Karma

to4kawa
Ultra Champion

UPDATE:

Sample:

| makeresults 
| eval _raw="{
   \"tapName\": \"tapData\",
   \"tapUuid\": \"22015f427a12\",
   \"diff\": {
     \"actValue\": \"tap_actualValue\",
     \"address\": \"[email protected]\",
     \"diffType\": \"SAMPLE_DIFFERENCE\",
     \"expValue\": \"tap_expectedValue\",
     \"fieldName\": \"Sample\",
     \"fullPath\": \"/http://www.gmail.com/file\",
     \"path\": \"/send\"
       }
 }" 
| spath diff output=message 
| spath input=message 
| fields - _* message

Result:

actValue,address,diffType,expValue,fieldName,fullPath,path
tap_actualValue,[email protected],SAMPLE_DIFFERENCE,tap_expectedValue,Sample,/http://www.gmail.com/file,/send

Recommend:

 index=tap-prod sourcetype=prod jobId=e62-71c72ccb3aec diff 
| spath path=diff output=message
| spath input=message
| fields - _* message
| table fieldName path expValue actValue address

Can you provide props.conf?

0 Karma

rashhvarikuti
New Member

Thank you for your reply.

I tried using with your solution but getting same results.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Detection Engineering Office Hours: Real-World Troubleshooting & Q&A

[REGISTER HERE] This thread is for the Community Office Hours session on Detection Engineering Office Hours: ...

Developer Spotlight with Mika Borner

From Hackathon Winner to Enterprise Leader    Mika Borner, CEO and Founder of Datapunctum AG, has been ...

Continue Your Federation Journey: Join Session 3 of the Bootcamp Series

To help practitioners build a stronger foundation, we launched the Data Management & Federation ...