topic Re: need rex help in Splunk Search

need rex help

vikram1583 — Mon, 02 Mar 2020 01:24:13 GMT

in my event i want to extract TLD's

i want to extract:
com
news
tech
net
org

please help me with rex?
thanks in advance

Re: need rex help

efavreau — Mon, 02 Mar 2020 14:07:25 GMT

@vikram1583 What do your logs look like? Are you extracting from fields that already identified websites or email addresses or do you have a mess in your logs that you need to identify the pattern first and then the TLD? Are these URL's fully qualified, like https://www.example.com/, or are the more like example.com? Do they end at the TLD, or continue with parameters/directories/etc.? Details and a log sample will go a long way in people being able to help you efficiently.

Re: need rex help

manjunathmeti — Mon, 02 Mar 2020 14:15:33 GMT

Hi @vikram1583,

Try this:

| rex "\w*\.(?<tld>[a-z]+)$"

Re: need rex help

to4kawa — Mon, 02 Mar 2020 14:56:33 GMT

rex field=your_field "(?<TLD>com|news|tech|net|org)"

Re: need rex help

vikram1583 — Mon, 02 Mar 2020 18:53:25 GMT

not working

Re: need rex help

manjunathmeti — Mon, 02 Mar 2020 19:05:00 GMT

Please share some raw data.

Re: need rex help

sumanssah — Mon, 02 Mar 2020 19:12:44 GMT

Try this

(?<TLD>\.\w+?)(?:$|\/)

Re: need rex help

to4kawa — Mon, 02 Mar 2020 21:10:43 GMT

not working
hec? what is "TLD" you say?

Re: need rex help

efavreau — Mon, 02 Mar 2020 21:21:56 GMT

@vikram1583 I maintain that this will go better with more details and a log sample. Please edit your question with a sample log (scrub for anything sensitive). Some of these proposed solutions aren't successful against patterns such as:
https://answers.splunk.com/answers/806969/need-rex-help.html (where the valid TLD is com)
www.example.wanggou (where the valid TLD would be wanggou)
etc.

Re: need rex help

woodcock — Tue, 03 Mar 2020 08:45:06 GMT

URL Toolbox: https://splunkbase.splunk.com/app/2734/