IPv6 addresses parsed properly?

EricPartington — Thu, 28 Oct 2010 01:39:31 GMT

Does splunk have any issues with parsing out IPv6 addresses from firewall events? I guess it all depends on how the transforms are written and how the fields are delimited (Cisco App written to parse IPv6).

Has anyone successfully parsed IPv6 or noticed any issues or caveats that we should be aware of?

Re: IPv6 addresses parsed properly?

Rob — Mon, 29 Nov 2010 20:54:54 GMT

There are several formats in which IPv6 can be displayed in your event log. You will want to use transforms.conf to find and parse these addresses. Here is a list of regex that matches the different forms. (The IPv4 address converted to IPv6 used in the examples below is 192.168.10.100 with a net mask of 255.255.255.0)

Full IPv6 address:

fe80:0000:0000:0000:0000:0000:c0a8:a64

Regex to match and return full address as $1:

([0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4})

IPv6 drop leading zero's:

fe80:0:0:0:0:0:c0a8:a64

Regex to match and return full address as $1 (yes, its the same as the above):

([0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4})

IPv6 collapse multiple zero's:

fe80::c0a8:a64

Regex to match collapsed zero groups. This will also work with collapsed zeros at the beginning of the address but not for single group addresses(e.g. '::1') and does not check for illegal IPv6 addresses (e.g. fe80::c0a8::a64):

(:?:?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[[::]?[0-9A-Fa-f]{1,4}]?)

To account for mixed IPv4 and IPv6 addresses, IPv6 allows for changing the last 4 bits to include the IPv4 address fe80:0000:0000:0000:0000:0000:c0a8:a64 would then be noted with the quad address at the end and become 'fe80:0000:0000:0000:0000:0000:192.168.10.100'.

Full IPv6 with IPv4 quad:

fe80:0000:0000:0000:0000:0000:192.168.10.100

Regex to match:

([0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:(?:\d{1,3}.){3}\d{1,3})

IPv6 dropping leading zero's with IPv4 quad:

fe80:0:0:0:0:0:192.168.10.100

Regex to match (same as above):

 ([0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:[0-9A-Fa-f]{1,4}:(?:\d{1,3}.){3}\d{1,3})

IPv6 with collapsed zero's and IPv4 quad:

fe80::192.168.10.100

Regex to match:

(:?:?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[::]?[0-9A-Fa-f]{1,4}:?[[::]?[0-9A-Fa-f]{1,4}]?(?:\d{1,3}.){3}\d{1,3})

Depending on the IPv6 address type that you are seeing in your events, you may want to tailor the regex to fit your IPv6 addresses more specifically.

Re: IPv6 addresses parsed properly?

araitz — Mon, 29 Nov 2010 22:59:12 GMT

Certainly some example IPv6 addresses in the events themselves would be useful....

Re: IPv6 addresses parsed properly?

stefanlasiewski — Tue, 20 Mar 2012 00:35:31 GMT

Note that the IETF has proposed RFC 5952 to "define a canonical textual representation format" across all systems and codes. Currently, IPv6 is difficult to parse, and the wide range of regex rules is going to leave holes in many apps. Hopefully RFC 5952 will bring some sanity to this mess.

Re: IPv6 addresses parsed properly?

jtrucks — Mon, 18 Mar 2013 19:16:28 GMT

How do you use these in an actual search?

Re: IPv6 addresses parsed properly?

stefanlasiewski — Tue, 16 Dec 2014 19:44:45 GMT

Can I use all 6 of these patterns and combine them into a single 'type' called 'IPv6 address'?

topic Re: IPv6 addresses parsed properly? in Splunk Search

IPv6 addresses parsed properly?

Re: IPv6 addresses parsed properly?

Full IPv6 address:

IPv6 drop leading zero's:

IPv6 collapse multiple zero's:

Full IPv6 with IPv4 quad:

IPv6 dropping leading zero's with IPv4 quad:

IPv6 with collapsed zero's and IPv4 quad:

Re: IPv6 addresses parsed properly?

Re: IPv6 addresses parsed properly?

Re: IPv6 addresses parsed properly?

Re: IPv6 addresses parsed properly?