topic Re: Top-Level Domain Extraction (from URLs) in Getting Data In

Top-Level Domain Extraction (from URLs)

dsmeerkat — Fri, 26 May 2017 11:26:33 GMT

So I've searched and searched and can't find a regex that quite fits what I want to do...What I'd like to do is extract just the ".com", ".net", ".org", etc from a URL.
My "domain" field shows: "http://cdn.springserve.com" or "https://www.allpennystocks.org", etc (for example).

I also get "www.familylifeins.com/Resources/Shared/scripts/widgets.js" sometimes in the domain field and of course I want to drop everything but the ".com"

What I need is just the top-level domain (".com", ".net", ".org", etc), and I've tried several different regex's I found here, but they don't quite work the way I need it to.

Basically I want to create a list of all the TLDs my company uses in a 90 day period.

Re: Top-Level Domain Extraction (from URLs)

richgalloway — Fri, 26 May 2017 12:54:21 GMT

Try this regex string.

(?<TLD>\.\w+?)(?:$|\/)

Re: Top-Level Domain Extraction (from URLs)

rjthibod — Fri, 26 May 2017 13:04:04 GMT

Great minds think alike 😉

Re: Top-Level Domain Extraction (from URLs)

woodcock — Fri, 26 May 2017 13:50:06 GMT

There are apps for that stuff:

URL Tollbox: https://splunkbase.splunk.com/app/2734/
URL Parser: https://splunkbase.splunk.com/app/1545/
URL Expander: https://splunkbase.splunk.com/app/3460/
URL Parser: https://splunkbase.splunk.com/app/3396/

Re: Top-Level Domain Extraction (from URLs)

dsmeerkat — Fri, 26 May 2017 13:58:31 GMT

Thank you everyone...VERY much!

Re: Top-Level Domain Extraction (from URLs)

woodcock — Fri, 26 May 2017 14:00:36 GMT

Don't forget to click Accept on the best answer (for you) and upvote anything else that was helpful.