gVddlmZddlmZddlZddlZddlZddlZddlmZm Z ejdk\r ddl m Z m Z mZmZn ddlmZ mZ mZmZej(eZdddddddddddd Zdddddddddd Zd d d ddiddddddddddddddddddd dd d!d" d#d$d%dd&d'd(d)d*d+d,d-d.d/d0d1d2d3d4d5dd6d" d7ZGd8d9Zy):)NetError)unique_everseenN)datetime timedelta)r) ip_address ip_networksummarize_address_rangecollapse_addresses) IPAddress IPNetworkr collapse_address_list) cidrnamehandlerangecountryaddress postal_code nameserverscreatedupdatedcontacts) remail reply_email organizationdivisiontitlephonefaxrJPzFhttp://whois.nic.ad.jp/cgi-bin/whois_gw?lang=%2Fe&key={0}&submit=queryGETAcceptz text/htmlz((\[Organization\])[^\S\n]+(?P.*?)\nz((\[Network Name\])[^\S\n]+(?P.*?)\nz)(\[Assigned Date\])[^\S\n]+(?P.*?)\nz'(\[Last Update\])[^\S\n]+(?P.*?)\nz&(\[Nameserver\])[^\S\n]+(?P.*?)\nz=(\[Administrative Contact\])[^\S\n]+.+?\>(?P.+?)\<\/A\> z8(\[Technical Contact\])[^\S\n]+.+?\>(?P.+?)\<\/A\> )rrrrr contact_admin contact_techz'(\[Last, First\])[^\S\n]+(?P.*?)\nz"(\[E-Mail\])[^\S\n]+(?P.*?)\nz&(\[Reply Mail\])[^\S\n]+(?P.*?)\nz$(\[Division\])[^\S\n]+(?P.*?)\nz!(\[Title\])[^\S\n]+(?P.*?)\nz(\[TEL\])[^\S\n]+(?P.*?)\nz(\[FAX\])[^\S\n]+(?P.*?)\nz%Y/%m/%d %H:%M:%S(JST) F) country_codeurl request_typerequest_headersform_data_ip_fieldfieldscontact_fields dt_format dt_hourdelta multi_netKRz8https://xn--c79as89aj0e29b77z.xn--3e0b707e/eng/whois.jscPOSTz8https://xn--c79as89aj0e29b77z.xn--3e0b707e/eng/whois.jsp)r$Refererqueryz0(Organization Name)[\s]+\:[^\S\n]+(?P.+?)\nz7(Service Name|Network Type)[\s]+\:[^\S\n]+(?P.+?) z&(Address)[\s]+\:[^\S\n]+(?P.+?)\nz'(Zip Code)[\s]+\:[^\S\n]+(?P.+?)\nz0(Registration Date)[\s]+\:[^\S\n]+(?P.+?)\nz1(id="eng_isp_contact").+?\>(?P.*?)\<\/div\> z2(id="eng_user_contact").+?\>(?P.*?)\<\/div\> )rrrrrr%r&z'(Name)[^\S\n]+?:[^\S\n]+?(?P.*?)\nz)(E-Mail)[^\S\n]+?:[^\S\n]+?(?P.*?)\nz((Phone)[^\S\n]+?:[^\S\n]+?(?P.*?)\n)rrr z%Y%m%dT)jpnickrniccHeZdZdZdZ d dZdZdZ d dZ d dZ y) NIRWhoisa The class for parsing whois data for NIRs (National Internet Registry). JPNIC and KRNIC are currently the only NIRs supported. Output varies based on NIR specific whois formatting. Args: net (:obj:`ipwhois.net.Net`): The network object. Raises: NetError: The parameter provided is not an instance of ipwhois.net.Net IPDefinedError: The address provided is defined (does not need to be resolved). cLddlm}t||r||_yt d)Nr)Netz@The provided net parameter is not an instance of ipwhois.net.Net)netr; isinstance_netr)selfr<r;s /opt/Tautulli/lib/ipwhois/nir.py__init__zNIRWhois.__init__s, c3 DI-. .Nc dj|}|r"i} syttjn[dddiid} sPttjj dj dj dfd|jD} | D]9\} } tjt| tj} || j|||} n&|| j||} n| j|} g}| D]1} |j |jd j3t!|d kDsd} | d vrB|r@ t#j$|d t|t'| z j)d }n5| dvrtt-|}nt-|}dj/|}|| | <<| S#t$rYwxYw#t*$r+t#j$|d dj)d }YLwxYw#t*$r/}t0j3dj| |Yd}~d}~wwxYw)a  The function for parsing whois fields from a data input. Args: response (:obj:`str`): The response from the whois/rwhois server. fields_dict (:obj:`dict`): The mapping of fields to regex search values (required). net_start (:obj:`int`): The starting point of the network (if parsing multiple networks). Defaults to None. net_end (:obj:`int`): The ending point of the network (if parsing multiple networks). Defaults to None. dt_format (:obj:`str`): The format of datetime fields if known. Defaults to None. field_list (:obj:`list` of :obj:`str`): If provided, fields to parse. Defaults to :obj:`ipwhois.nir.BASE_NET` if is_contact is False. Otherwise, defaults to :obj:`ipwhois.nir.BASE_CONTACT`. hourdelta (:obj:`int`): The timezone delta for created/updated fields. Defaults to 0. is_contact (:obj:`bool`): If True, uses contact information field parsing. Defaults to False. Returns: dict: A dictionary of fields provided in fields_dict, mapping to the results of the regex searches. z{0} Nadmintech)rr%r&rr%r&c34K|]\}}|vr||fyw)N).0fieldpattern field_lists r@ z(NIRWhois.parse_fields..s,@)9%+0J+>G$@svalr)rr)hoursTz%Y/%m/%d)r z+NIR whois field parsing failed for {0}: {1})formatlist BASE_CONTACTkeysBASE_NETremoveappenditemsrecompilestrDOTALLfinditergroupstrip IndexErrorlenrstrptimer isoformat ValueErrorrjoinlogdebug)r?response fields_dict net_startnet_endr/rL hourdelta is_contactretgeneraterJrKmatchvaluesmvaluees ` r@ parse_fieldszNIRWhois.parse_fieldssw<>>(+ C!,"3"3"56 '+D9!# "C !(--/2 !!*-!!/2!!.1@%%'@'C #NE7jjG  G $((7IF$((7; ((2F MM!''%."6"6"89  6{Q  669 - ( 1 1$*1I$' N!"%.I$>!?(in "/1 $_V%< ="1!8 $ & 1#E GC #J W"$ *- ( 1 1$*1I$.!"(in "-""II!!'q!13 sN%.G,'H2.>G;,6H2, G87G8;1H/,H2.H//H22 I*;%I%%I*cg}tjd|tjD]} tjt }t |jd} |j} |j}dj|dz||d<t |jdjj}||d<|j!|d<|j#|d<|j%||S#t$r|j}YwxYw#t$r|j}YwxYw#t&t(f$rY'wxYw) a The function for parsing network blocks from jpnic whois data. Args: response (:obj:`str`): The response from the jpnic server. Returns: list of dict: Mapping of networks with start and end positions. :: [{ 'cidr' (str) - The network routing block 'start' (int) - The starting point of the network 'end' (int) - The endpoint point of the network }] z5^.*?(\[Network Number\])[^\S\n]+.+?>(?P.+?)$ {0} - {1}rrrstartend)rZr^ MULTILINEcopydeepcopyrVr r_network_addressAttributeErroripbroadcast_address broadcastrRr`__str__rzr{rXre TypeError) r?rinetsrqr<tmprrrs r@get_nets_jpniczNIRWhois.get_nets_jpnic.sK&[[H  $ E  mmH- Q0&)&9&9O (+(=(=% +11#a'): G "%++a."6"6"89AAC"F ${{}G "YY[E  C A$ L 3&&)ffO &(+ % *  sT3D= D- D"9B D=DD=DD="D:7D=9D::D==EEc g}tjd|tjD]} tjt }|j d|d<|j dr|j drg}|jtt|j djt|j djdjt|Dcgc]}|jc}}dj|j d|j d|d<n6t|j djj}||d<|j!|d <|j#|d <|j%||Scc}w#t&t(f$rYwxYw) a The function for parsing network blocks from krnic whois data. Args: response (:obj:`str`): The response from the krnic server. Returns: list of dict: Mapping of networks with start and end positions. :: [{ 'cidr' (str) - The network routing block 'start' (int) - The starting point of the network 'end' (int) - The endpoint point of the network }] zK^(IPv4 Address)[\s]+:[^\S\n]+((.+?)[^\S\n]-[^\S\n](.+?)[^\S ]\((.+?)\)|.+)$rxrrz, ryrrzr{)rZr^r|r}r~rVr_extendr r r`rfr rrRr rzr{rXrer)r?rirrqr<addrsirs r@get_nets_krniczNIRWhois.get_nets_krnicms&[[+  & E mmH-${{1~G ;;q>ekk!nELL!8"5;;q>#7#7#9:"5;;q>#7#7#9:"<= 99.@.GHHD$/#5#5 A A$CL &ekk!n&:&:&<=EEGD"F ${{}G "YY[E  C E& P )I  *  s%CG =G B-G G  GGc &|s|dk(r|}nU|jjtt|dj ||t|dt|d}|j |t|d|t t|dd S) a The function for retrieving and parsing NIR whois data based on NIR_WHOIS contact_fields. Args: response (:obj:`str`): Optional response object, this bypasses the lookup. nir (:obj:`str`): The NIR to query ('jpnic' or 'krnic'). Required if response is None. handle (:obj:`str`): For NIRs that have separate contact queries (JPNIC), this is the contact handle to use in the query. Defaults to None. retry_count (:obj:`int`): The number of times to retry in case socket errors, timeouts, connection resets, etc. are encountered. Defaults to 3. dt_format (:obj:`str`): The format of datetime fields if known. Defaults to None. Returns: dict: Mapping of the fields provided in contact_fields, to their parsed results. r7r)r+r*)r) retry_countheadersr*r.r0T)rirjr/rmrn)r> get_http_rawr\ NIR_WHOISrRrvint)r?rinirrrr/contact_responses r@ get_contactzNIRWhois.get_contacts2 sg~'  $yy55 #u-.55f='!#'89&s^N; 6    %!#'78)C.89 !  rBc |tjvr td|jjdd}||r tdt j dj|jjd}t|dr"t|d|jji}|jjtt|dj|jj|t|dt|d | }|r||d <g} d} |d k(r|j|} n|d k(r|j|} | j| i} t j dt| D]C\} } d}| dzt| kr | | dzd} t|d}|j|t|d|| d||t!t|d}t|d|d<|d|dd}|d=|d=|s|j#D]\}}t|dkDst%|tr|j'}|D]U}|| jvr | ||d|<!|d k(r|}d}nd}|}|j)||||||d|<|d|| |<W| j+|| d=| d=F| |d<|S#t$rd}Y*wxYw)a The function for retrieving and parsing NIR whois information for an IP address via HTTP (HTML scraping). Args: nir (:obj:`str`): The NIR to query ('jpnic' or 'krnic'). Required if response is None. inc_raw (:obj:`bool`, optional): Whether to include the raw results in the returned dictionary. Defaults to False. retry_count (:obj:`int`): The number of times to retry in case socket errors, timeouts, connection resets, etc. are encountered. Defaults to 3. response (:obj:`str`): Optional response object, this bypasses the NIR lookup. Required when is_offline=True. field_list (:obj:`list` of :obj:`str`): If provided, fields to parse. Defaults to :obj:`ipwhois.nir.BASE_NET`. is_offline (:obj:`bool`): Whether to perform lookups offline. If True, response and asn_data must be provided. Primarily used for testing. Returns: dict: The NIR whois results: :: { 'query' (str) - The IP address. 'nets' (list of dict) - Network information which consists of the fields listed in the ipwhois.nir.NIR_WHOIS dictionary. 'raw' (str) - Raw NIR whois results if the inc_raw parameter is True. } z/Invalid arg for nir (National Internet RegistryN)r5rawz/response argument required when is_offline=Truez0Response not given, perform WHOIS lookup for {0}r,r)r+r*)r)rrr* form_datarr6r7zParsing NIR WHOIS datarrzr/r-r{r0)rirjrkrlr/rLrmr(rr%r&rDrr)rirrrr/r)rrUKeyErrorr> address_strrgrhrRrr\rrr enumeraterbrvrrYr= splitlinesrupdate)r?rinc_rawrrirL is_offlineresultsrr nets_responseglobal_contactsindexr< section_endr/temp_netrkeyrNcontact tmp_response tmp_handles r@lookupzNIRWhois.lookupsuJ inn& &LM MYY**    122 IIHvdii334 6I~23&s^,@A!YY224 yy-- #u-.55dii6K6KL'!#'89&s^N;# .H %GEN '> //9M G^ //9M M" *+#D/O )JE3Kqy3t9$"519og6  !%cN;7 ((!%cN84%E #%in^<=)H#,C."@HY !/2 0H )( ( 0%"HC3x!|%c3/"%.."2C'*"G&/*>*>*@@%4G$<!) 4S 9 $''>3:L15J48L18J<@B-2~@=~?B;?-1- ^GK+0rrBr9)rutilsrloggingsysrZr}rr version_info ipaddressr r r r ipaddrr rr getLoggerrrgrVrTrr9rHrBr@rs|2" *v// EE g!            $k2"?ACAD88  ?:DG?975A  .? DI!J &G@EJ,+  ?A@ =EB  JrB