th*7 ddlZddlZddlZddlZddlmZmZmZmZm Z m Z m Z m Z ddl mZmZddlmZddddd d d d d ddd ZdZdZdZedddfZeZdededefdZde ede efdZde ede efdZde ede efdZdedefdZdedejfdZdejdejdefd Z d!ed"edefd#Z!d$ejd!ed"edefd%Z"dedefd&Z#Gd'd(Z$de eeeeffd)Z%de eeeeffd*Z&de eeeeffd+Z' d2d,eed-edeeefd.Z(d,eed-edeeefd/Z)d0ede e eeffd1Z*y)3N)IOAnyDictListOptionalTupleUnioncast)subputil) uses_systemddelta descriptionelapsed event_typeindentlevelnameoriginresult timestamp total_time) z%dz%Dz%Ez%ez%Iz%lz%nz%oz%rz%tz%T successfulfailure containermsgeventreturnctjD]9\}}||vs |dvr|j|d|z}%|j|d|z};|jdi|S)N)rrrz {%s:08.5f}z{%s}) format_keyitemsreplaceformat)rrijs 8/usr/lib/python3/dist-packages/cloudinit/analyze/show.py format_recordr)9sm  "11 855kk!\A%56kk!VaZ0 1 3::  c*|r|jdSy)Nrgetrs r( event_namer/Ds yy  r*c*|r|jdSy)Nrr,r.s r(rrJs yy&& r*cFt|}|r|jddSy)N/r)r/split)rrs r( event_parentr4Ps% e D zz#q!! r*cT|jd}| tdt|S)NrzEvent is missing a 'timestamp')r- ValueErrorfloat)rtss r(event_timestampr9Ws+ ; B z9:: 9r*ctjjt|tjjSN)datetime fromtimestampr9timezoneutcr.s r(event_datetimer@^s1    * * 1 1 5 5 r*t1t2c(||z jSr;) total_seconds)rArBs r( delta_secondsrEds G " " $$r*startfinishc>tt|t|Sr;)rEr@)rFrGs r(event_durationrIhs .v0F GGr* start_timec |j}t|}d}|r|d|jddz zdzz }|jt ||t |t ||d|S)N| r2z`->)rrr)copyr/countupdaterIrEr@)rJrFrGrecordrrs r( event_recordrSlsv [[]F e D F #C1,-55 MM#E62$Z1FG  Mr*c d|zS)NzTotal Time: %3.5f seconds r!)rs r(total_time_recordrUs (: 55r*cPeZdZdZd dedeefdZdeeeeffdZ de fdZ y) SystemctlReaderzQ Class for dealing with all systemctl subp calls in a consistent manner. Nproperty parametercd|_tjddg|_|r|jj ||jj d|dg|j |_y)N systemctlshowz-pz--timestamp=us+utc)stdoutr whichargsappendextend_subpr)selfrXrYs r(__init__zSystemctlReader.__init__s^%) **[16:  II  Y ' $*>?@ zz| r*rc tj|jd\}}|r|S||_y#t$r }|cYd}~Sd}~wwxYw)z Make a subp call based on set args and handle errors by setting failure code :return: whether the subp call failed or not TcaptureN)r r_r] Exception)rcvalueerrsystemctl_fails r(rbzSystemctlReader._subpsG "499d;JE3 DK "! ! "s'22 AAAAc|jr$tdj|j|j td|jj ddj }|j rt|dz }|Stjj|djtjjj}|S)z{ If subp call succeeded, return the timestamp from subp as a float. :return: timestamp as a float zBSubprocess call to systemctl has failed, returning error code ({})z.stdout of subprocess call to systemctl is None=rNi@Bz%a %Y-%m-%d %H:%M:%S.%f %Z)tzinfo)r RuntimeErrorr%r]r3strip isnumericr7r<strptimer$r>r?r)rcvalrs r(convert_val_to_floatz$SystemctlReader.convert_val_to_floats <<,,2F4<<,@  ;; @  kk$Q'--/ ==?c W,I !!**30LM 1 1 5 56  r*r;) __name__ __module__ __qualname____doc__strrrdr rhrbr7rtr!r*r(rWrWsD$$#$$"xc9n 56" +e+r*rWctr tStjs'dtjdj vr t StS)a) Determine which init system a particular linux distro is using. Each init system (systemd, etc) has a different way of providing timestamps. :return: timestamps of kernelboot, kernelendboot, and cloud-initstart or TIMESTAMP_UNKNOWN if the timestamps cannot be retrieved. gentoosystem)r gather_timestamps_using_systemdr is_FreeBSD system_infolowergather_timestamps_using_dmesgTIMESTAMP_UNKNOWNr!r*r(dist_check_timestamprsM~.00 H(8(8(:8(D(J(J(LL,.. r*c tjdgd\}}|dj}|D]}|jdjddk7s'|jdj }|dj d }t |}t tjt tjz }||z}t|||fcS tS#t$rYtSwxYw) a Gather timestamps that corresponds to kernel begin initialization, kernel finish initialization using dmesg as opposed to systemctl :return: the two timestamps plus a dummy timestamp to keep consistency with gather_timestamps_using_systemd dmesgTrfrzUTF-8userrrN]) r splitlinesdecodefindr3rpr7timer uptime SUCCESS_CODErhr) data_ split_entriesr&splitupstrippeduser_space_timestamp kernel_start kernel_ends r(rrs ))WIt4aQ**,  JAxx %%f-3((7+113"1:++C0(-X$$TYY[1E$++-4HH ),@@ $\:zII J"     sAC+B C+#C++ C<;C<c tjr3tdj}tdj}n2tdj}tdj}tdj|z }tddj|z }tjrtnt}||||z||zfS#t$r}t |t cYd}~Sd}~wwxYw)z Gather timestamps that corresponds to kernel begin initialization, kernel finish initialization. and cloud-init systemd unit activation :return: the three timesread_propertystamps UserspaceTimestampUserspaceTimestampMonotonicKernelTimestampKernelTimestampMonotonicInactiveExitTimestampMonotoniczcloud-init-localN) r is_containerrWrtrhprintrCONTAINER_CODEr)rmonotonic_offsetrcloudinit_sysdestatuss r(r}r}s!&!    +$""$  /- ""$ +!""$  /* ""$  - ""$   02D ""$   $002^ F z!~%   ! a  !sB2C D)C?9D?Devents print_formatc t|d}g}d}d}i}g}g}tt|D]} || } || dz} t | dk(r|rE| j ddk(r1|j t||j |g}d}d}|t| }||t| <t| t| k(rFt | d k(stt| } |j t|t|| | |j d | j dz|j | |j} t| t| k(rI|s@t|| | } |j td | d z|| j d xsdz }|j | |j t||j ||S#t$rd} YwxYw)as Take in raw events and create parent-child dependencies between events in order to order events in chronological order. :param events: JSONs from dump that represents events taken from logs :param print_format: formatting to represent event, time stamp, and time taken by the event in one line :return: boot records ordered chronologically c |dS)Nrr!)xs r(z"generate_records..Ws ;r*)keyNgrNrFrz init-localrGzStarting stage: %szFinished stage: (%n) %d seconds r)sortedrangelen IndexErrorrr-r`rUr@r4r/r rr)rSpop)rr sorted_eventsrecordsrJrstage_start_time boot_records unprocessedrrnext_evtprev_evtrRs r(generate_recordsrHs6'?@MGJJLK 3}% &2-q  a!e}H e  '599V, <0<=##G,!  !+E2 8B e!45% Jx$88h'83 $D(3HNN%((UHE3eii6GGH""5)"(H% Jx$88)*hFFNN%=v &**W"5"<>r*infilec|j}|jsAtjj d|j ztj d tj||fS#t$rd|fcYSwxYw)z Takes in a log file, read it, and convert to json. :param infile: The Log file to be read :return: json version of logfile, raw file zEmpty file %s rNN) readrpsysstderrwriterexitjsonloadsr6)rrs r(load_events_infilersq ;;=D ::< *V[[89  zz$%% Tzs#A:: B  B )z(%n) %d seconds in %I%D)+r<rrrtypingrrrrrrr r cloudinitr r cloudinit.distrosr r"r FAIL_CODErrEventryr)r/rr4r7r9r@rErIrSrUrWrrr}rrrr!r*r(rsf DDD *,               B+ s5Shuo(3- huo(3- HSM5U%H$5$5 %h''%X->->%5%H%HH5H!!   *6%6C6RRjeCu$<=,uS%-E'F>6sE5%/G)H6v2M KMM $s)_M` ?U ?3 ?4S ? ?reHSM3,>&?r*