topic Re: SPL: extract logfile name from source field in Splunk Search

SPL: extract logfile name from source field

danielsofoulis — Thu, 20 Apr 2017 23:50:08 GMT

Hi, I am trying to setup a dropdown bar for a dashboard and would like to setup dynamic inputs based on the source log file, as there are many different sites being built and torn down.

example source log name:

D:\Apache\logs\example.com.au_accessLog_2017-04-20-00_00_00.log

I would like to extract "example.com.au" from the above source log file and drop everything else. Then make it a distinct value. This value would then be selectable in the dropdown bar to filter on that site.

This is what I've attempted but is not returning what I need.

index=example sourcetype=test:access | eval baseurl = mvindex(split(source,"/", -1) | top baseurl

Thanks in advance.

Re: SPL: extract logfile name from source field

cpetterborg — Fri, 21 Apr 2017 00:13:44 GMT

The following should work for you to extract the part you want from the source field:

index=example sourcetype=test:access | rex field=source "\\(?P<file>[^_\\]+)_[^\\]$"

Re: SPL: extract logfile name from source field

jkat54 — Fri, 21 Apr 2017 00:19:38 GMT

...| rex field=source "logs\\(?<fqdn>\S+)_accessLog" | top fqdn

Re: SPL: extract logfile name from source field

danielsofoulis — Fri, 21 Apr 2017 00:39:33 GMT

Thank you for answering. I ran the search with the rex you provided and got the following error:
Error in 'rex' command: Encountered the following error while compiling the regex '(?P[^]+)[^]$': Regex: missing terminating ] for character class

Re: SPL: extract logfile name from source field

danielsofoulis — Fri, 21 Apr 2017 00:40:42 GMT

Hi thanks for you help, but I'm also getting an error when I run your rex:
Error in 'rex' command: Encountered the following error while compiling the regex 'logs(

Re: SPL: extract logfile name from source field

danielsofoulis — Fri, 21 Apr 2017 00:57:59 GMT

I've managed to get it working using
rex field=source "\w+\(?P[\w+]+)_accessLog\S+$"| top 20 site

Re: SPL: extract logfile name from source field

jkat54 — Fri, 21 Apr 2017 12:51:21 GMT

Sorry I had my question mark in the wrong place.