gHddlZddlmZddlmZddlZddlZddlZddlZddl Z ddl m Z ddl Z ejdk\rddlmZmZmZmZmZmZmZnddlmZmZmZmZmZmZmZ ddlmZe j<eZ id d d d ddddddddddddddddddd d!d"d#d$d%d&d'd(d)Z!d*Z"d+Z#d,Z$d4d-Z%d.Z&d/Z'd5d0Z(d6d1Z)d7d2Z*d7d3Z+y#e$r dd lmZYtwxYw)8N) parseString)path) namedtuple)r) ip_address ip_network IPv4Address IPv4Network IPv6Addresssummarize_address_rangecollapse_addresses) IPAddress IPNetworkr r r r collapse_address_list) filterfalse) ifilterfalseRFC 1122, Section 3.2.1.3z2http://tools.ietf.org/html/rfc1122#section-3.2.1.3RFC 1918z"http://tools.ietf.org/html/rfc1918RFC 3927z"http://tools.ietf.org/html/rfc3927RFC 5736z"http://tools.ietf.org/html/rfc5736RFC 5737z"http://tools.ietf.org/html/rfc5737RFC 3068z"http://tools.ietf.org/html/rfc3068RFC 2544z"http://tools.ietf.org/html/rfc2544RFC 3171z"http://tools.ietf.org/html/rfc3171RFC 919, Section 7z+http://tools.ietf.org/html/rfc919#section-7RFC 4291, Section 2.7z.http://tools.ietf.org/html/rfc4291#section-2.7RFC 4291z"http://tools.ietf.org/html/rfc4291RFC 4291, Section 2.5.2z0http://tools.ietf.org/html/rfc4291#section-2.5.2RFC 4291, Section 2.5.3z0http://tools.ietf.org/html/rfc4291#section-2.5.3RFC 4291, Section 2.5.6z0http://tools.ietf.org/html/rfc4291#section-2.5.6RFC 4291, Section 2.5.7z0http://tools.ietf.org/html/rfc4291#section-2.5.7RFC 4193z#https://tools.ietf.org/html/rfc4193a(?P(((25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)(\.)){3}(25[0-5]|2[0-4][0-9]|[01]?[0-9][0-9]?)|\[?(((([0-9A-Fa-f]{1,4}:){7}([0-9A-Fa-f]{1,4}|:))|(([0-9A-Fa-f]{1,4}:){6}(:[0-9A-Fa-f]{1,4}|((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3})|:))|(([0-9A-Fa-f]{1,4}:){5}(((:[0-9A-Fa-f]{1,4}){1,2})|:((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3})|:))|(([0-9A-Fa-f]{1,4}:){4}(((:[0-9A-Fa-f]{1,4}){1,3})|((:[0-9A-Fa-f]{1,4})?:((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3}))|:))|(([0-9A-Fa-f]{1,4}:){3}(((:[0-9A-Fa-f]{1,4}){1,4})|((:[0-9A-Fa-f]{1,4}){0,2}:((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3}))|:))|(([0-9A-Fa-f]{1,4}:){2}(((:[0-9A-Fa-f]{1,4}){1,5})|((:[0-9A-Fa-f]{1,4}){0,3}:((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3}))|:))|(([0-9A-Fa-f]{1,4}:){1}(((:[0-9A-Fa-f]{1,4}){1,6})|((:[0-9A-Fa-f]{1,4}){0,4}:((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3}))|:))|(:(((:[0-9A-Fa-f]{1,4}){1,7})|((:[0-9A-Fa-f]{1,4}){0,5}:((25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)(\.(25[0-5]|2[0-4]\d|1\d\d|[1-9]?\d)){3}))|:)))(%.+)?))\]?((:(6553[0-5]|655[0-2]\d|65[0-4]\d{2}|6[0-4]\d{3}|[1-5]\d{4}|[1-9]\d{0,3}))|(\/(?:[012]\d?|3[012]?|[4-9])))?)c|jjd}t|D]8\}}|jddjd||<||dvs4d||<:dj |S)z The function to strip leading zeros in each octet of an IPv4 address. Args: address (:obj:`str`): An IPv4 address. Returns: str: The modified IPv4 address. ./r0)N)stripsplit enumeratelstripjoin)addressobjxys "/opt/Tautulli/lib/ipwhois/utils.pyipv4_lstrip_zerosr2usx --/   $C#1a'',A q6Z CF  88C=c g} |jtt|t|t|Dcgc]}|jc}S#ttt f$r |jtt |jt |jnP#t$rD|jtt |jt |jYnwxYwYwxYwcc}w)a The function to calculate a CIDR range(s) from a start and end IP address. Args: start_address (:obj:`str`): The starting IP address. end_address (:obj:`str`): The ending IP address. Returns: list of str: The calculated CIDR ranges. ) extendr rKeyError ValueError TypeErrorrnetwork_addressAttributeErroripr __str__) start_address end_address tmp_addrsis r1calculate_cidrrAsI-0 } % { #% &$"4I!> ?AAIIK ?? j) , - -   4=)99;'779 : -   4=),,;'**, - - - @s<-ADD-AB/.D/A C<9D;C<<DDci}tjdk(r5ttddr$tjtj }ntjt }|rtjdjt|dztjt|dzdd}|j}|j|siSt|}|j!d }|D]e}|j!d d j"j$}|j!d d j"j$} | j'||<g|Stjd jt|dztjt|dzdd}t)j*|dd} | D]} | d }| d} | ||<|j|S)aU The function to generate a dictionary containing ISO_3166-1 country codes to names. Args: is_legacy_xml (:obj:`bool`): Whether to use the older country code list (iso_3166-1_list_en.xml). Returns: dict: A mapping of country codes as the keys to the country names as the values. win32frozenFz$Opening country code legacy XML: {0}z/data/iso_3166-1_list_en.xmlrz ISO-8859-1)encodingzISO_3166-1_EntryzISO_3166-1_Alpha-2_Code_elementrzISO_3166-1_Country_namezOpening country code CSV: {0}z/data/iso_3166-1.csvzutf-8,") delimiter quotechar)sysplatformgetattrrdirname executable__file__logdebugformatstrioopenreadclosergetElementsByTagName firstChilddatatitlecsvreader) is_legacy_xml countriesdata_dirfr\domentriesentrycodename csv_readerrows r1 get_countriesrksI ||w73%#@<</<<) 8??H >>@ A GGCM$BBC) +vvx  I$**+=> +E--133466@j --)++,..8j #jjlIdO +F - 188H >>@ A GGCM$::C$ &ZZSC@  #Cq6Dq6D#IdO #  r3ctt|}tdd}|tdvr |dddS|jr |dddS|j r |ddd S|td vr |dd d S|td vr |dddS|tdvr |dddS|tdvr |dddS|tdvr |dddS|tdvr |dddS|j r |dddS|tdvr |dddS|jr |ddd S|td!vr |dd"d#S|d$d#d#S)%a The function for checking if an IPv4 address is defined (does not need to be resolved). Args: address (:obj:`str`): An IPv4 address. Returns: namedtuple: :is_defined (bool): True if given address is defined, otherwise False :ietf_name (str): IETF assignment name if given address is defined, otherwise '' :ietf_rfc (str): IETF assignment RFC if given address is defined, otherwise '' ipv4_is_defined_resultsis_defined, ietf_name, ietf_rfcz 0.0.0.0/8Tz This NetworkrLoopbackz Link Localrz 192.0.0.0/24zIETF Protocol Assignmentsrz 192.0.2.0/24z TEST-NET-1rz192.88.99.0/24z6to4 Relay Anycastrz 198.18.0.0/15z-Network Interconnect Device Benchmark Testingrz198.51.100.0/24z TEST-NET-2z203.0.113.0/24z TEST-NET-3 Multicastrz255.255.255.255/32zLimited BroadcastrzPrivate-Use Networksrz198.97.38.0/24z IANA Reservedr'F)r rUrr is_loopback is_link_local is_multicast is_privater-query_ipresultss r1ipv4_is_definedrx s(3w<(H25?@G;{++t^-HII   tZ)DEE   t\:66 [0 0t8*EE [0 0t\:66 [!12 2t1:>> [1 1?"$ % [!23 3t\:66 [!12 2t\:66   t[*55 [!56 6t02FGG   t3Z@@ [!12 2t_b11 5"b !!r3ctt|}tdd}|jr |dddS|jr |dddS|j r |ddd S|j r |dd d S|jr |dd d S|jr |dddS|jr |dddS|dddS)a The function for checking if an IPv6 address is defined (does not need to be resolved). Args: address (:obj:`str`): An IPv6 address. Returns: namedtuple: :is_defined (bool): True if given address is defined, otherwise False :ietf_name (str): IETF assignment name if given address is defined, otherwise '' :ietf_rfc (str): IETF assignment RFC if given address is defined, otherwise '' ipv6_is_defined_resultsrnTrpr UnspecifiedrrorReservedrz Link-Localr z Site-Localr!zUnique Local Unicastr"Fr') r rUrrsis_unspecifiedrq is_reservedrr is_site_localrtrus r1ipv6_is_definedrls(3w<(H25?@Gt[*ABB  t],EFF   tZ)BCC   tZ44   t\+DEE   t\+DEE   t3Z@@ 5"b !!r3c#Kt}|j}|(t|j|D]}|||y|D]}||}||vs|||yw)az The generator to list unique elements, preserving the order. Remember all elements ever seen. This was taken from the itertools recipes. Args: iterable (:obj:`iter`): An iterable to process. key (:obj:`callable`): Optional function to run when checking elements (e.g., str.lower) Yields: The next unique element found. N)setaddr __contains__)iterablekeyseenseen_addelementks r1unique_everseenrss 5DxxH {"4#4#4h? G W M   GG A}   s AA$A$cH|s |s tdi}did}d}|rbtjdjt |t t |d}|j }|jtjt ttj}tjdjt |||fD]}|s|j|D]}d} d} |jd } d | vr d | vr| jd } | d} | d } n.d | vr| jd} | dd d} | d } n d| vrd} | } n| } | r t| }n t!| }|j#}||j%vrt'j(|||<||dxxd z cc<| r ||dt | xxd z cc< |S#t*$rd ||dt | <Y&wxYw#t*tf$rY)wxYw)a The function to search an input string and/or file, extracting and counting IPv4/IPv6 addresses/networks. Summarizes ports with sub-counts. If both a string and file_path are provided, it will process them both. Args: data (:obj:`str`): The data to process. file_path (:obj:`str`): An optional file path to process. Returns: dict: The addresses/networks mapped to ports and counts: :: { '1.2.3.4' (dict) - Each address or network found is a dictionary: { 'count' (int) - Total number of times seen. 'ports' (dict) - Mapping of port numbers as keys and the number of times seen for this ip as values. } } Raises: ValueError: Arguments provided are invalid. zNo data or file path provided.r)countportsNz-Opening file for unique address analysis: {0}rEzAnalyzing input/file dataFr;r$:rK[z]:r%Trr)r7rRrSrTrUrWrXrYrecompileIP_REGEXDOTALLfinditergroupr)rrr<keyscopydeepcopyr6)r\ file_pathretbase file_datarcpattern input_datamatchis_netportfoundr) ip_or_netip_objobj_strs r1unique_addressesrsF:  9:: C D I AHHI  ! Y %FFH   jj H  G II)00I !Y'= !))*58 4!KK-Ee|u % C 0$)!H $Qx % D 1$)!HQRL $Qx!%$) %* !+I!6",I!6$nn.Gchhj0'+}}T':G L)Q.)AL1#d)<Aw'*wg/E QJE KK M %-s A+A0.A0c #Kd}t}||kratttjdddzdz }t |ds||vr|dz }|j ||||kr`yyw)a The generator to produce random, unique IPv6 addresses that are not defined (can be looked up using ipwhois). Args: total (:obj:`int`): The total number of IPv6 addresses to generate. Yields: str: The next IPv6 address. rrKN)rrUr rrrrrs r1ipv6_generate_randomrest EeG %-k&..AsF1H"=>?w'*wg/E QJE KK M %-s A1A64A6)F)N)NN)d),rLxml.dom.minidomrosrrrrVr^r collectionsrlogging version_info ipaddressrrr r r r r ipaddrrrr itertoolsr ImportErrorr getLogger__name__rRIETF_RFC_REFERENCESrr2rArkrxrrrrrr3r1rs2 ' "v///EEE6% g!84  4  4 4444GM46!"6%&6)*6-.5/6  <0"@JVr^"B<"~!Hzz2[656s$C CC