Getting Data In

rebuild a syslog event

asabatini
Splunk Employee
Splunk Employee

Hi Folks,

 

I have a quick question.

currently I have a syslog event and I need to see in splunk the raw data the info in different order:

Example

original syslog

(?<field1>REGEX),(?<field2>REGEX),(?<field3>REGEX),  etc.......

what I want to see indexed in splunk

(?<field1>REGEX),(?<field3>REGEX),,(?<TIMESTAP>REGEX),(?<field2>REGEX).

I tried with SED command in props.conf is really useful to clean the data but not to reorder the info.

 

Thanks in advance

Alex

 

Labels (3)
0 Karma

scelikok
SplunkTrust
SplunkTrust

Hi @asabatini,

I think the problem is name-capturing groups in REGEX. Using name-capturing groups will already create a field without a FORMAT parameter. 

You can try one of the below options;

Using name-capturing groups in REGEX;

[group1]
REGEX = (?<group1>.+\s\-\s\-\s\-\s).*.auditID.:.(?<group2>[\w-]+)..*requestURI.:.(?<group4>[^,]+).+username.:.(?<group5>[^,]+).+sourceIPs....(?<group3>\d+.\d+.\d+.\d+)

Without name-capturing groups in REGEX;

[group1]
REGEX = (.+\s\-\s\-\s\-\s).*.auditID.:.([\w-]+)..*requestURI.:.([^,]+).+username.:.([^,]+).+sourceIPs....(\d+.\d+.\d+.\d+)
FORMAT = group1::$1, group2::$2, group5::$3, group3::$4, group4::$5

 

If this reply helps you an upvote and "Accept as Solution" is appreciated.
0 Karma

scelikok
SplunkTrust
SplunkTrust

Hi @asabatini,

You can reorder or modify raw data using transforms,  you need to capture parts of the messages and reorder them like $1$3$2, etc.

please see the document below;

https://docs.splunk.com/Documentation/Splunk/9.0.3/Data/Anonymizedata#Configure_the_transforms.conf_...

If this reply helps you an upvote and "Accept as Solution" is appreciated.

asabatini
Splunk Employee
Splunk Employee

Hi @scelikok 

I agree with you, I would show you my props and transforms conf file

props.conf

[custom_syslog]
transforms-rebuild = group1
SHOULD_LINEMERGE = false

 

Transforms

[group1]
REGEX = (?<group1>.+\s\-\s\-\s\-\s).*.auditID.:.(?<group2>[\w-]+)..*requestURI.:.(?<group3>[^,]+).+username.:.(?<group4>[^,]+).+sourceIPs....(?<group5>\d+.\d+.\d+.\d+)
FORMAT = group1::$1, group2::$2, group5::$3, group3::$4, group4::$5

 

Did I forget something in the conf files?

Regards

Alessandro

0 Karma

PickleRick
SplunkTrust
SplunkTrust

Hi Alessandro.

If that's your actual copy-pasted excerpt from props.conf you have

transforms-rebuild = group1

instead of

TRANSFORMS-rebuild = group1

(yes, case does matter here)

Got questions? Get answers!

Join the Splunk Community Slack to learn, troubleshoot, and make connections with fellow Splunk practitioners in real time!

Meet up IRL or virtually!

Join Splunk User Groups to connect and learn in-person by region or remotely by topic or industry.

Get Updates on the Splunk Community!

Accelerate Splunk App Development with AI

  Learn how to automate the repetitive parts of your build cycle.   Watch On-Demand   Replay the Accelerate ...

Splunk Agent Observability: Measuring AI Value with Splunk Tokenomics on AWS

The AI landscape is moving faster than ever, and our latest 2026 State of Observability report provides the ...

Enterprise Security Watch Party: What’s New in 8.8 - Recap

Splunk Community HQ hosted a Splunk Enterprise Security Watch Party: What’s New In ES 8.8 last Thursday. I had ...