g#n ddlZddlZddlZddlZddlmZmZmZmZm Z m Z m Z m Z ejdk\rddlmZnddlmZej$eZddddddZdd d d d d ddiZdddddddddd d d dddiZGddZGddZy)N)NetErrorASNRegistryError ASNParseErrorASNLookupErrorHTTPLookupErrorWhoisLookupErrorWhoisRateLimitErrorASNOriginLookupError)r ) ip_network) IPNetwork)cidr description maintainerupdatedsourceradbzwhois.radb.netz(descr):[^\S\n]+(?P.+?)\nz(mnt-by):[^\S\n]+(?P.+?)\nz (changed):[^\S\n]+(?P.+?)\nz(source):[^\S\n]+(?P.+?)\nrrrr)serverfieldszhttp://www.radb.net/querykeywords1Queryorigin)advanced_queryquery ip_optionz-iz -i optionz(source):[^\S\n]+(?P.+?)\<)urlform_data_asn_field form_datarc<eZdZdZdZdZdZdZd dZ d dZ y) IPASNz The class for parsing ASN data for an IP address. Args: net (:obj:`ipwhois.net.Net`): A ipwhois.net.Net object. Raises: NetError: The parameter provided is not an instance of ipwhois.net.Net czddlm}m}ddlm}t ||r||_n td||_||_ y)Nr)NetORG_MAP) RIR_WHOIS@The provided net parameter is not an instance of ipwhois.net.Net) netr&r'whoisr( isinstance_netrorg_map rir_whois)selfr*r&r'r(s /opt/Tautulli/lib/ipwhois/asn.py__init__zIPASN.__init__`s?'$ c3 DI-. . "c |jd}d|djdi}|d|jjvrt dj |d|djd|d<|d jd|d <|d jdj |d <|d jd|d<d|d<|S#t$rt$r#}tdj ||ddd}~wwxYw)aE The function for parsing ASN fields from a dns response. Args: response (:obj:`str`): The response from the ASN dns server. Returns: dict: The ASN lookup results :: { 'asn' (str) - The Autonomous System Number 'asn_date' (str) - The ASN Allocation date 'asn_registry' (str) - The assigned ASN registry 'asn_cidr' (str) - The assigned ASN CIDR 'asn_country_code' (str) - The assigned ASN country code 'asn_description' (None) - Cannot retrieve with this method. } Raises: ASNRegistryError: The ASN registry is not known. ASNParseError: ASN parsing failed. | asn_registryr  ASN registry {0} is not known.r " asnrasn_cidrasn_country_codeasn_dateNasn_description-Parsing failed for "{0}" with exception: {1}.d splitstripr/keysrformatupper Exceptionrr0responsetempretes r1parse_fields_dnszIPASN.parse_fields_dnsrs&6 >>>#&D"47==#78C>"$..*=*=*??&4;;N+- av.CJ"1gmmE2C O&*1gmmE&:&@&@&BC" #"1gmmF3C O%)C! "     >!##)6(A#6t!=> > >CCD (DD c |jd}d|djdi}|d|jjvrt dj |d|djd|d<d |d <|d jdj |d <|d jd|d<|djd|d<|S#t$rt$r#}tdj ||d dd }~wwxYw)a3 The function for parsing ASN fields from a verbose dns response. Args: response (:obj:`str`): The response from the ASN dns server. Returns: dict: The ASN lookup results :: { 'asn' (str) - The Autonomous System Number 'asn_date' (str) - The ASN Allocation date 'asn_registry' (str) - The assigned ASN registry 'asn_cidr' (None) - Cannot retrieve with this method. 'asn_country_code' (str) - The assigned ASN country code 'asn_description' (str) - The ASN description } Raises: ASNRegistryError: The ASN registry is not known. ASNParseError: ASN parsing failed. r5r6r<r7r8rr9r:Nr;rr=r r?r>r@rArBrCrJs r1parse_fields_verbose_dnszIPASN.parse_fields_verbose_dnss&4 >>>#&D"47==#78C>"$..*=*=*??&4;;N+- av.CJ"C O&*1gmmE&:&@&@&BC" #"1gmmE2C O%)!W]]6%:C! "     >!##)6(A#6t!=> > >rPc@ |jd}d|djdi}|d|jjvrt dj |d|djd|d<|djd|d <|d jdj |d <|d jd|d <|djd|d<|S#t$rt$r#}tdj ||ddd}~wwxYw)a" The function for parsing ASN fields from a whois response. Args: response (:obj:`str`): The response from the ASN whois server. Returns: dict: The ASN lookup results :: { 'asn' (str) - The Autonomous System Number 'asn_date' (str) - The ASN Allocation date 'asn_registry' (str) - The assigned ASN registry 'asn_cidr' (str) - The assigned ASN CIDR 'asn_country_code' (str) - The assigned ASN country code 'asn_description' (str) - The ASN description } Raises: ASNRegistryError: The ASN registry is not known. ASNParseError: ASN parsing failed. r5r6r>r7r8rr:r<r;r r=r?r@rANrBrCrJs r1parse_fields_whoiszIPASN.parse_fields_whoiss34 >>>#&D"47==#78C>"$..*=*=*??&4;;N+- au-CJ"1gmmE2C O&*1gmmE&:&@&@&BC" #"1gmmE2C O%)!W]]5%9C! "     >!##)6(A#6t!=> > >sC$C((D:DDNc |jj} |j| ddddddd} |dd}t|ts|g}t|D] } ||ddj|d<n|ds tjd td  |S#ttt t f$rYwxYw#t tf$rtjdg}YwxYw#t $r7}tjd jt|Yd}~d}~wwxYw#t$rt $r#}t#d j||dd d}~wwxYw)a The function for parsing ASN fields from a http response. Args: response (:obj:`str`): The response from the ASN http server. extra_org_map (:obj:`dict`): Dictionary mapping org handles to RIRs. This is for limited cases where ARIN REST (ASN fallback HTTP lookup) does not show an RIR as the org handle e.g., DNIC (which is now the built in ORG_MAP) e.g., {'DNIC': 'arin'}. Valid RIR values are (note the case-sensitive - this is meant to match the REST result): 'ARIN', 'RIPE', 'apnic', 'lacnic', 'afrinic'. Defaults to None. Returns: dict: The ASN lookup results :: { 'asn' (None) - Cannot retrieve with this method. 'asn_date' (None) - Cannot retrieve with this method. 'asn_registry' (str) - The assigned ASN registry 'asn_cidr' (None) - Cannot retrieve with this method. 'asn_country_code' (None) - Cannot retrieve with this method. 'asn_description' (None) - Cannot retrieve with this method. } Raises: ASNRegistryError: The ASN registry is not known. ASNParseError: ASN parsing failed. N)r6r:r;r=r?r@netsr*zNo networks foundorgRefz@handler6z*Could not parse ASN registry via HTTP: {0}z%Could not parse ASN registry via HTTPzASN registry lookup failed.rArB)r.copyupdate TypeError ValueError IndexErrorKeyErrorr,listlogdebugreversedrHrGstrrrIr)r0rK extra_org_mapr.asn_datanet_listnrNs r1parse_fields_httpzIPASN.parse_fields_httpsH,,##%  NN= ) 3 >!% $( #' H #F+E2!(D1 (zHh'   ( I 6 < < >?^,  N+ AB&'DEE,s:z8<   ,i(  -.  II$$*F3q6N4     >!##)6(A#6t!=> > >suB) D7CD7"C4>(D7)CC&C1.D70C11D74 D4=-D/*D7/D44D77E, E''E,c *|gd}n hdj|r td|}d}d}d} t|D]^\} } | dk(r |jjj |xr|xsdz|jj_|jj}g} |D]+} | j|jt| -| jd} t|d j}| D]$}t|d j}||kDs!|}|}& d } nm| d k(r/ |jj)|}|j+|}n9| dk(s0 |jj-|}|j/||}n| t!d|rI| rG |jj1dj'|d}|j3|}|d|d<|r||d<|S#ttf$rYwxYw#tt f$r/}t"j%d j'|Yd}~d}~wwxYw#tt f$r/}t"j%d j'|Yd}~Rd}~wwxYw#tt f$r/}t"j%dj'|Yd}~d}~wwxYw#tt f$r/}t"j%dj'|Yd}~d}~wwxYw)a The wrapper function for retrieving and parsing ASN information for an IP address. Args: inc_raw (:obj:`bool`): Whether to include the raw results in the returned dictionary. Defaults to False. retry_count (:obj:`int`): The number of times to retry in case socket errors, timeouts, connection resets, etc. are encountered. Defaults to 3. extra_org_map (:obj:`dict`): Mapping org handles to RIRs. This is for limited cases where ARIN REST (ASN fallback HTTP lookup) does not show an RIR as the org handle e.g., DNIC (which is now the built in ORG_MAP) e.g., {'DNIC': 'arin'}. Valid RIR values are (note the case-sensitive - this is meant to match the REST result): 'ARIN', 'RIPE', 'apnic', 'lacnic', 'afrinic' Defaults to None. asn_methods (:obj:`list`): ASN lookup types to attempt, in order. If None, defaults to all: ['dns', 'whois', 'http']. get_asn_description (:obj:`bool`): Whether to run an additional query when pulling ASN information via dns, in order to get the ASN description. Defaults to True. Returns: dict: The ASN lookup results :: { 'asn' (str) - The Autonomous System Number 'asn_date' (str) - The ASN Allocation date 'asn_registry' (str) - The assigned ASN registry 'asn_cidr' (str) - The assigned ASN CIDR 'asn_country_code' (str) - The assigned ASN country code 'asn_description' (str) - The ASN description 'raw' (str) - Raw ASN results if the inc_raw parameter is True. } Raises: ValueError: methods argument requires one of dns, whois, http. ASNRegistryError: ASN registry does not match. N)dnsr+http>rkrlr+z;methods argument requires at least one of dns, whois, http.Frkrrr;TzASN DNS lookup failed: {0}r+zASN WHOIS lookup failed: {0}rl) retry_countzASN HTTP lookup failed: {0}z.ASN lookup failed with no more methods to try.AS{0}r:r@z"ASN DNS verbose lookup failed: {0}raw) isdisjointr] enumerater- dns_resolvertimeoutlifetime get_asn_dnsappendrOrdpopr prefixlenr_rrrarbrG get_asn_whoisrV get_asn_httpriget_asn_verbose_dnsrR)r0inc_rawrmre asn_methodsget_asn_descriptionlookupsrKrf dns_successindex lookup_method asn_data_list asn_entry prefix_len asn_parsedprefix_len_comprNasn_verbose_datas r1lookupz IPASN.lookupsJ\  .G(22;? "566"G $-g$6G  E=%% ..66'7K<1II**3 $yy446H$&M%-- %,,T-B-B N.,-- -003H %/0D%E%O%O *7=J.8 *: 6/88A ,.;+5-< =#'K') #yy66{CH#66  "H&( #yy55$/ 6 H $55h7D FHEG R  "$*+ + ; 9988UO:%&#'#@#@#J .>%/'*+ &HUOE%j1'(89II:AA!DE'(89II<CCAFG '(89II;BB1EF(#$45  >EEaHI sB!H(:G<#G<)H4,I*.J-AK<H H HHI $I  IJ!$J  JK"$K  KL#$L  LN)Fr NNT) __name__ __module__ __qualname____doc__r2rOrRrVrirr3r1r$r$Ts5 #$8t7r7rbHBF59_r3r$c6eZdZdZdZ ddZddZ d dZy) ASNOriginz The class for parsing ASN origin whois data Args: net (:obj:`ipwhois.net.Net`): A ipwhois.net.Net object. Raises: NetError: The parameter provided is not an instance of ipwhois.net.Net cLddlm}t||r||_yt d)Nr)r&r))r*r&r,r-r)r0r*r&s r1r2zASNOrigin.__init__0s, c3 DI-. .r3Nci}sgdfd|jD}|D]\}} tjt| tj} || j |||} n&|| j ||} n| j |} g} d} | D][} | r| | j dz k7rnA | j| jdj| j} ]t| dkDsd} | d}|||<|S#t$rY=wxYw#t$r/}tjdj!||Yd}~Kd}~wwxYw)a The function for parsing ASN whois fields from a data input. Args: response (:obj:`str`): The response from the whois/rwhois server. fields_dict (:obj:`dict`): Mapping of fields->regex search values. net_start (:obj:`int`): The starting point of the network (if parsing multiple networks). Defaults to None. net_end (:obj:`int`): The ending point of the network (if parsing multiple networks). Defaults to None. field_list (:obj:`list`): If provided, a list of fields to parse: ['description', 'maintainer', 'updated', 'source'] If None, defaults to all fields. Returns: dict: A dictionary of fields provided in fields_dict. rc34K|]\}}|vr||fywrr).0fieldpattern field_lists r1 z)ASNOrigin.parse_fields..Xs,@)9%+0J+>G$@sNrvalrz2ASN origin Whois field parsing failed for {0}: {1})itemsrecompilerdDOTALLfinditerstartrvgrouprEr^endlenr]rarbrG)r0rK fields_dict net_startnet_endrrMgeneraterrmatchvaluessub_section_endmvaluerNs ` r1 parse_fieldszASNOrigin.parse_fields>s|(KJ@%%'@'3 #NE7jjG  G $((7IF$((7; ((2F"O *"&1779q=9MM!''%."6"6"89 #$%%' *"6{Q"1IE#E g3 #j +""II$$*F5!$46 s*8.D D' D$#D$' E0%EEcpg}|rd}nd}tj||tjD]u} tjt }|j dj|d<|j|d<|j|d<|j|w|S#t$rYwxYw)a The function for parsing network blocks from ASN origin data. Args: response (:obj:`str`): The response from the RADB whois/http server. is_http (:obj:`bool`): If the query is RADB HTTP instead of whois, set to True. Defaults to False. Returns: list: A list of network block dictionaries :: [{ 'cidr' (str) - The assigned CIDR 'start' (int) - The index for the start of the parsed network block 'end' (int) - The index for the end of the parsed network block }] z"route(?:6)?:[^\S\n]+(?P.+?)\nz$^route(?:6)?:[^\S\n]+(?P.+|.+)$rrrr) rr MULTILINErZdeepcopyBASE_NETrrErrrvr])r0rKis_httprXregexrr*s r1 get_nets_radbzASNOrigin.get_nets_radbs0 9E;E[[   E mmH-#kk!n224F ${{}G "YY[E  C  $   sA2B)) B54B5c|dddk7rdj|}|ddg}n ddhj|r td|}|gdd }d } |t|D]\} } | dk(rD tj d j||j j|| }nh| dk(sU tj dj||j jdjtdd||d}d} n| td|r||d<g} |j|| }| j|| rt}nt }tj dt| D]X\} }d}| dzt#| kr | | dzd}|j%||dd||d|}|j'||d=|d=Z| |d<|S#ttf$r/} tj d j| Yd} ~ d} ~ wwxYw#t$r/} tj dj| Yd} ~ d} ~ wwxYw)a? The function for retrieving and parsing ASN origin whois information via port 43/tcp (WHOIS). Args: asn (:obj:`str`): The ASN (required). inc_raw (:obj:`bool`): Whether to include the raw results in the returned dictionary. Defaults to False. retry_count (:obj:`int`): The number of times to retry in case socket errors, timeouts, connection resets, etc. are encountered. Defaults to 3. response (:obj:`str`): Optional response object, this bypasses the Whois lookup. Defaults to None. field_list (:obj:`list`): If provided, fields to parse: ['description', 'maintainer', 'updated', 'source'] If None, defaults to all. asn_methods (:obj:`list`): ASN lookup types to attempt, in order. If None, defaults to all ['whois', 'http']. Returns: dict: The ASN origin lookup results :: { 'query' (str) - The Autonomous System Number 'nets' (list) - Dictionaries containing network information which consists of the fields listed in the ASN_ORIGIN_WHOIS dictionary. 'raw' (str) - Raw ASN origin whois results if the inc_raw parameter is True. } Raises: ValueError: methods argument requires one of whois, http. ASNOriginLookupError: ASN origin lookup failed. rr<ASrnNr+rlz6methods argument requires at least one of whois, http.)rrXroFz;Response not given, perform ASN origin WHOIS lookup for {0})r:rmz#ASN origin WHOIS lookup failed: {0}z;Response not given, perform ASN origin HTTP lookup for: {0}zM{0}?advanced_query=1&keywords={1}&-T+option=&ip_option=&-i=1&-i+option=originrr GET)r rm request_typeTz"ASN origin HTTP lookup failed: {0}z5ASN origin lookup failed with no more methods to try.rozParsing ASN origin datarrrrrX)rGrpr]rqrarbr-get_asn_origin_whoisr r get_http_rawASN_ORIGIN_HTTPrr rextendASN_ORIGIN_WHOISrrr[)r0r:r|rmrKrr}rresultsrrrrNrX nets_responserr* section_endtemp_nets r1rzASNOrigin.lookupsP q8t ..%C  'G ++K8 "011"G    (1'(:1 $} G+ #99?F$(99#A#A #$B$#f, #99?F$(99#9#9"F#)6/&*A%*H##N(3). $:$#'W1 f*,BCC %GEN**8W=  M" $F%F +,#D/ )JE3Kqy3t9$"519og6 ((vx(E  H JJx G c%j' ),g-.AB #%%+VAY0 :+ #%%+VAY0 s2"AG,AHH&$HH I!$I  I)NNN)F)NFr NNN)rrrrr2rrrrr3r1rr$s2  .=A.2Rh3jGK,0hr3r)rsysrZlogging exceptionsrrrrrr r r version_info ipaddressr ipaddrr getLoggerrrarrrr$rrr3r1rs2 DDDv$/g!    "<<:8     *)!!  =<:8   ,MM`KKr3