Splunk Search

Field extraction with duplicate values in fields

kmattern
Builder

Splunk 4.0.10

I have a log file that has 5 fields, date, time, account, received, authorized. It looks like this:

4/14/2010 11:25:08 washington-i 0 13

4/14/2010 11:25:08 jefferson-i 13 13

4/14/2010 11:25:08 jackson-i 13 13

4/14/2010 11:25:08 madison-i 13 13

4/14/2010 11:25:08 polk-i 13 13

4/14/2010 11:25:08 lincoln 12 12

4/14/2010 11:25:08 carter 0 4

4/14/2010 11:25:08 reagan 7 7

4/14/2010 11:25:08 johnson-I 12 12

4/14/2010 11:25:08 eisenhauer 7 7

4/14/2010 11:25:08 jefferson-1 13 13

When I do a search and click on extract fields I can't get Splunk to recognize every received field and it refuses to see the authorized field. I need to be able to generate a report that will display the difference between these two fields. How do I get Splunk to extract these fields?

Tags (1)
0 Karma
1 Solution

bwooden
Splunk Employee
Splunk Employee

One option may be to do this via transforms.conf

To get started you could add or append these two files on your Splunk search instance.

$SPLUNK_HOME/etc/system/local/props.conf
[unknown-too_small]
KV_MODE = none
REPORT-foo = RecAuthz

$SPLUNK_HOME/etc/system/local/transforms.conf
[RecAuthz]
REGEX = ([0-9]+/[0-9]+/[0-9]+)\s([0-9|:]+)\s(\S+)\s(\d+)\s(\d+)
FORMAT = date::$1 time::$2 account::$3 received::$4 authorized::$5

---
Alternate transforms.conf (easier to read solution)
[RecAuthz]
DELIMS = " "
FIELDS = "date", "time", "account", "received", "authorized"

View solution in original post

bwooden
Splunk Employee
Splunk Employee

One option may be to do this via transforms.conf

To get started you could add or append these two files on your Splunk search instance.

$SPLUNK_HOME/etc/system/local/props.conf
[unknown-too_small]
KV_MODE = none
REPORT-foo = RecAuthz

$SPLUNK_HOME/etc/system/local/transforms.conf
[RecAuthz]
REGEX = ([0-9]+/[0-9]+/[0-9]+)\s([0-9|:]+)\s(\S+)\s(\d+)\s(\d+)
FORMAT = date::$1 time::$2 account::$3 received::$4 authorized::$5

---
Alternate transforms.conf (easier to read solution)
[RecAuthz]
DELIMS = " "
FIELDS = "date", "time", "account", "received", "authorized"

kmattern
Builder

Thanks, that worked!

0 Karma

bwooden
Splunk Employee
Splunk Employee

...assuming you're an admin on that instance.

0 Karma
Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Think Like an Architect: Introducing the Splunk Certified Cybersecurity Defense ...

In cybersecurity, defenders respond to threats. Architects design the systems that stop them.    As ...

Best Practices: Splunk auto adjust pipeline queue

When you enable autoAdjustQueue in Splunk, maxSize should be understood as the queue size Splunk starts with ...

Announcing Modern Navigation: A New Era of Splunk User Experience

We are excited to introduce the Modern Navigation feature in the Splunk Platform, available to both cloud and ...