Splunk Search

Field transformation does not work but rex does with the same regex expression

av
Loves-to-Learn

I am trying to extract a field using field transformation. My event contains a XML. Partial snippet given below -

 

                    <Name>/xx</Name>
                    <Id>HASPR00100</Id>
                    <Class>B</Class>
                    <Confidence>0.8957</Confidence>
                    <Notes>
                        <Note>
                            <Key name="note">[CDATA[{"target": "corp", "precision": 0.365, "recall": 0.553, "fnr": 0.447, "fpr": 0.0273, "confidence": {"A": 0.0, "B": 0.8957}}]]</Key>
                            <Key name="score">0.0271</Key>

 

I am trying to capture the "score" value 0.0271 in a field.

I tried to create a field transformation using regex below  -

\<Name\>\/xx\<\/Name\>\n.+\n.+\n.+\n.+\n.+\n.+\n.+\<Key name\=\"score\"\>(\S+)\<\/Key\>

But that does not work. If I use the same expression in rex I am able to extract the field.

index=a ... | rex "\<Name\>\/xx\<\/Name\>\n.+\n.+\n.+\n.+\n.+\n.+\n.+\<Key name\=\"score\"\>(?<sc>.*)\<\/Key\>"

Am i missing something? Or is there any better way to do this?

Thanks.

Labels (3)
0 Karma

harsmarvania57
Ultra Champion

Any specific reason to use field transformation ? You can use field extraction to achieve the same (Define regex in field extraction directly).

0 Karma

av
Loves-to-Learn

@harsmarvania57  Tried your suggestion, but same result using direct regex in field extraction. Not sure what am I missing.

Tags (1)
0 Karma

harsmarvania57
Ultra Champion

Can you please let us know regex which you have configured in field extraction and one simple raw event (Not partial event) ?

0 Karma

av
Loves-to-Learn

I was able to make it work with following regex

xx[^\$]+?score\"\>(\S+)\<
0 Karma
Get Updates on the Splunk Community!

Splunk Mobile: Your Brand-New Home Screen

Meet Your New Mobile Hub  Hello Splunk Community!  Staying connected to your data—no matter where you are—is ...

Introducing Value Insights (Beta): Understand the Business Impact your organization ...

Real progress on your strategic priorities starts with knowing the business outcomes your teams are delivering ...

Enterprise Security (ES) Essentials 8.3 is Now GA — Smarter Detections, Faster ...

As of today, Enterprise Security (ES) Essentials 8.3 is now generally available, helping SOC teams simplify ...