Splunk Search

How to extract specific data from a value?

msarkaus
Path Finder

Hello,

I would like to extract specific values from a log and display it in my Dashboard.

For example, the value is:

?QuoteId=CA10118&AgentId=12345&state=MN&Category=RetailSales

Is it possible to extract the word "AgentId=12345" and "state=MN"?

"AgentId" and "state" will always be the same. The value that follows will always change.

I would like to also display each value in a separate column

i.e.

Agent ID     State

12345          MN

Any help would be appreciated. 

Labels (1)
Tags (1)
0 Karma

PickleRick
SplunkTrust
SplunkTrust

Adding to the two answers you already have - if you use the fields often and if you filter your data on them it's good to define extractions for the sourcetype.

Due to how splunk works it should be much faster to do

<your conditions> Field=Value

using predefined extractions than

<your conditions>
| <command extracting field Field>
| search Field=Value

Sometimes splunk can optimize some sub-optimal searches but let's not add it unnecessary work 😉

0 Karma

yuanliu
SplunkTrust
SplunkTrust

An alternative is to just use kv (aka extract) command.  Assuming that the value belongs to a field uri, you can do

 

| rename _raw as temp, uri as _raw
| kv
| rename temp as _raw

 

 Now you have

AgentIdCategoryQuoteIdstate
12345RetailSalesCA10118MN
Tags (1)
0 Karma

bowesmana
SplunkTrust
SplunkTrust

Assuming your field containing the data is _raw, then use the rex statement in the working example below

| makeresults
| eval _raw="?QuoteId=CA10118&AgentId=12345&state=MN&Category=RetailSales"
| rex "AgentId=(?<AgentId>\d+).*state=(?<state>\w+)"
| table AgentId state

 This assumes that state will always follow AgentId

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Deep Dive: Accelerate threat investigation with Splunk’s AI Assistant in Security

AI is one of the biggest topics in the market today, and for security teams, its value goes far beyond the ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...

Detection Engineering Office Hours: Real-World Troubleshooting & Q&A

[REGISTER HERE] This thread is for the Community Office Hours session on Detection Engineering Office Hours: ...