topic Extract Field from source's file path in Splunk Search

Extract Field from source's file path

pl123 — Wed, 19 Jan 2011 13:57:12 GMT

Hi, I would to know if it is possible to use a part of the source events file path ie "foobar" from

/weblogs/123/https-blah.com/foobar

and extract it as a field or value (ie ws_server) in either a search or via transforms.conf / props.

Thanks

tedder — Wed, 19 Jan 2011 14:27:37 GMT

For using it in a search, you can test it with this:

rex field=_raw "https-blah.com/(?<path>\S*)"

Might have to adjust it, depending on what other values exist.

After that, use field extractions.

ziegfried — Wed, 19 Jan 2011 15:04:25 GMT

Yes you can extract it to a field. If you want to search for it, you will want to use a indexed field (as opposed to a search time extracted field).

props.conf

[your_sourcetype]
TRANSFORMS-extract-ws-server

transforms.conf

SOURCE_KEY = MetaData:Source
REGEX = /([^/]+)$
FORMAT = ws_server::$1
WRITE_META = true

fields.conf

[ws_server]
INDEXED = true
INDEXED_VALUE = false

Extracting a search-time field would be easier. Just specifing the extraction in props.conf:

[your_sourcetype]
EXTRACt-ws = ^/([^/]+)$ in source

marcoscala — Fri, 30 Sep 2011 14:04:33 GMT

The Search-time field extraction with EXTRACT key works fine and it's usually recommended by Splunk.