Getting Data In

Coalesce in transforms

knutsod
Path Finder

Hello,

I am working with some apache logs that can go through one or more proxies, when a request go through a proxy a X-forwarded-for header is added. The problem is that the apache logs show the client IP as the last address the request came from. The logs do however add the X-forwarded-for entries to the end of the log entry if they exist.

What I need to do is get the clientip field updated via transforms to the correct address so that the web analytics app gets the correct data. The following search shows an example of the goal.

index=weblogs
| rex field=other "^(?<first_forward>[0-9\.]+)"
| eval clientip=coalesce(first_forward, clientip)

The other field is already extracted and contains a comma separated list of the X-forwarded-for headers.

I see two options on how to solve this, unless there is some magic way to do evals in transforms/props.

1) I could create a regex to extract the values in transforms, but not sure how to coalesce them in transforms/props.

2) Create a macro that does the job, but then I would need to update every search in the app and this would make updating the app lame.

Any ideas?

0 Karma
Get Updates on the Splunk Community!

Unlock Database Monitoring with Splunk Observability Cloud

  In today’s fast-paced digital landscape, even minor database slowdowns can disrupt user experiences and ...

Purpose in Action: How Splunk Is Helping Power an Inclusive Future for All

At Cisco, purpose isn’t a tagline—it’s a commitment. Cisco’s FY25 Purpose Report outlines how the company is ...

[Upcoming Webinar] Demo Day: Transforming IT Operations with Splunk

Join us for a live Demo Day at the Cisco Store on January 21st 10:00am - 11:00am PST In the fast-paced world ...