Splunk Search

Regex to find a directory in a path

rileyken
Explorer

I have these paths as sources for an index (the paths are linux file system paths)

/usr/local/myfiles1/myfacilityA/Debug/ADT/ADT_2019-07-30.txt
/usr/local/myfiles2/myfacilityB/Debug/ADT/ADT_2019-07-30.txt
/usr/local/myfiles1/myfacilityC/Debug/ADT/ADT_2019-07-30.txt

i would like to be able to extract "myfacility" as a field so I can search for all of the events with that source path.

It would be fantastic to just capture everything between the /usr/local/myfiles? and the /Debug/ADT/ADT....

Tags (1)
0 Karma
1 Solution

jaime_ramirez
Communicator

For myfacility field:

...
| rex field=source "\/usr\/local\/myfiles\d+\/myfacility(?<myfacility>.*?)\/Debug\/ADT\/"

And for everything between the /usr/local/myfiles? and the /Debug/ADT/ADT:

...
| rex field=source "\/usr\/local\/myfiles(?<myfacilityPath>.*?)\/Debug\/ADT\/"

Hope it helps

View solution in original post

0 Karma

bwlm
Path Finder

If you would like to avoid cumbersome regex rules and are just looking for the fourth directory (or 0-4 directory path) you may want to consider the Splunk Multivalue eval functions "mvindex", "split", and "mvjoin" to do the work for you... note that the "nomv" commands are optional in most cases.

 

| makeresults
| eval filepathname="/usr/local/myfiles1/myfacilityA/Debug/ADT/ADT_2019-07-30.txt"
| eval Dir4=mvindex(split(filepathname,"/"),4,4) 
| nomv Dir4
| eval Dir0to4=mvjoin(mvindex( split(filepathname,"/"),0,4), "/") 
| nomv Dir0to4

 

 

0 Karma

rileyken
Explorer

This was just what I was looking for! Thanks Jamie

0 Karma

jaime_ramirez
Communicator

For myfacility field:

...
| rex field=source "\/usr\/local\/myfiles\d+\/myfacility(?<myfacility>.*?)\/Debug\/ADT\/"

And for everything between the /usr/local/myfiles? and the /Debug/ADT/ADT:

...
| rex field=source "\/usr\/local\/myfiles(?<myfacilityPath>.*?)\/Debug\/ADT\/"

Hope it helps

0 Karma
Get Updates on the Splunk Community!

See just what you’ve been missing | Observability tracks at Splunk University

Looking to sharpen your observability skills so you can better understand how to collect and analyze data from ...

Weezer at .conf25? Say it ain’t so!

Hello Splunkers, The countdown to .conf25 is on-and we've just turned up the volume! We're thrilled to ...

How SC4S Makes Suricata Logs Ingestion Simple

Network security monitoring has become increasingly critical for organizations of all sizes. Splunk has ...