gT@dZddlZ ddlZddlZddlZddlZddlZddlZddl Z ddl Z ddl Z ddl Z ddlmZej ZGddeZGddeZeZej/e_ej/e_ej/e_ej/e_ej/e_ ddlZ ej<dZGd d eZ!e!Z"y#e$r dZYwxYw#e $rd ZY*wxYw#e$rdZY7wxYw) a An implementation of the Web Site Process Bus. This module is completely standalone, depending only on the stdlib. Web Site Process Bus -------------------- A Bus object is used to contain and manage site-wide behavior: daemonization, HTTP server start/stop, process reload, signal handling, drop privileges, PID file management, logging for all of these, and many more. In addition, a Bus object provides a place for each web framework to register code that runs in response to site-wide events (like process start and stop), or which controls or otherwise interacts with the site-wide components mentioned above. For example, a framework which uses file-based templates would add known template filenames to an autoreload component. Ideally, a Bus object will be flexible enough to be useful in a variety of invocation scenarios: 1. The deployer starts a site from the command line via a framework-neutral deployment script; applications from multiple frameworks are mixed in a single site. Command-line arguments and configuration files are used to define site-wide components such as the HTTP server, WSGI component graph, autoreload behavior, signal handling, etc. 2. The deployer starts a site via some other process, such as Apache; applications from multiple frameworks are mixed in a single site. Autoreload and signal handling (from Python at least) are disabled. 3. The deployer starts a site via a framework-specific mechanism; for example, when running tests, exploring tutorials, or deploying single applications from a single framework. The framework controls which site-wide components are enabled as it sees fit. The Bus object in this package uses topic-based publish-subscribe messaging to accomplish all this. A few topic channels are built in ('start', 'stop', 'exit', 'graceful', 'log', and 'main'). Frameworks and site containers are free to define their own. If a message is sent to a channel that has not been defined or has no listeners, there is no effect. In general, there should only ever be a single Bus object per process. Frameworks and site containers share a single Bus object by publishing messages and subscribing listeners. The Bus object works as a finite state machine which models the current state of the process. Bus methods move it from one state to another; those methods then publish to subscribed listeners on the channel for the new state.:: O | V STOPPING --> STOPPED --> EXITING -> X A A | | \___ | | \ | | V V STARTED <-- STARTING N)always_iterablecFeZdZdZdZfdZdZdZdZeZ dZ e Z xZ S)ChannelFailuresz0Exception raised during errors on Bus.publish(). cJtt| |i|t|_y)z*Initialize ChannelFailures errors wrapper.N)superr__init__list _exceptions)selfargskwargs __class__s ,/opt/Tautulli/lib/cherrypy/process/wspbus.pyr zChannelFailures.__init__ds! ot-t>v>6cd|jjtjdy)z%Append the current exception to self.N)r appendsysexc_infor s rhandle_exceptionz ChannelFailures.handle_exceptionis!  q 12rc |jddS)z*Return a list of seen exception instances.N)r rs r get_instanceszChannelFailures.get_instancesms""rcttt|j}|jj |S)z5Render the list of errors, which happened in channel.)mapreprr delimiterjoin)r exception_stringss r__str__zChannelFailures.__str__qs.d&8&8&:;~~""#455rc,t|jS)z0Determine whether any error happened in channel.)boolr rs r__bool__zChannelFailures.__bool__xsD$$%%r) __name__ __module__ __qualname____doc__rr rrr!__repr__r$ __nonzero__ __classcell__)rs@rrr_s2:I" 3#6 H&Krrc(eZdZGddeZdZy) _StateEnumceZdZdZdZy)_StateEnum.StateNc d|jzS)Nz states.%s)namers rr)z_StateEnum.State.__repr__s* *r)r%r&r'r1r)rrStater/s  +rr3clt||jr||_tj |||yN) isinstancer3r1object __setattr__)r keyvalues rr8z_StateEnum.__setattr__s) eTZZ (EJ4e,rN)r%r&r'r7r3r8r2rrr-r-s++ -rr- SC_OPEN_MAXiceZdZdZeZej ZdZeZ dZ ddZ dZ dZ dZd Zd Zd Zd Zdd ZddZdZedZedZedZdZdZddZddZy)BusasProcess state-machine and messenger for HTTP site deployment. All listeners for a given channel are guaranteed to be called even if others at the same channel fail. Each failure is logged, but execution proceeds on to the next listener. The only way to stop all processing from inside a listener is to raise SystemExit and stop the whole server. Fc|d|_tj|_d}t d|D|_i|_y)zInitialize pub/sub bus.F)startstopexitgracefullogmainc34K|]}|tfywr5)set).0channels r zBus.__init__..s ce  sN)execvstatesSTOPPEDstatedict listeners _priorities)r channelss rr z Bus.__init__s< ^^ E #  rNc|"tj|j||S|jj |t }|j || t|dd}||j||f<y)zAdd the given callback at the given channel (if not present). If callback is None, return a partial suitable for decorating the callback. N)priorityrS2) functoolspartial subscriberO setdefaultrFaddgetattrrP)r rHcallbackrS ch_listenerss rrWz Bus.subscribes{  $$!  ~~00#%@ "  xR8H08'8,-rc|jj|}|r&||vr!|j||j||f=yyy)z(Discard the given callback (if present).N)rOgetdiscardrP)r rHr[rOs r unsubscribezBus.unsubscribesHNN&&w/ Y.   h '  '8!45/9rcjvrgSt}g}fdjD}t|tjd}|D]\}} |j | |i||r||S#t $rt$r1tjd} |r| jdk(rd| _ t$r3|jdk(rnjdd| dd YwxYw) z7Return output of all subscribers for the given channel.c3DK|]}j|f|fywr5)rP)rGlistenerrHr s rrIzBus.publish..s.   w1 2H = s r)r9rrCz Error in z listener (Tlevel traceback)rOrsortedoperator itemgetterrKeyboardInterrupt SystemExitrrcode ExceptionrrC) r rHr rexcoutput raw_itemsitemsrSrces `` rpublishz Bus.publishs $.. (I  NN73 yh&9&9!&<="' 7 Hh 7 h778 7& I %%  LLN1%166Q;AF 7$$&e#HH'8L#%7  7s!BA:C=<C=c|jtjk7r8tjd|jzt |j yy)z>Assert that the Bus is not running in atexit handler callback.zThe main thread is exiting, but the Bus is in the %r state; shutting it down automatically now. You must either call bus.block() after start(), or call bus.exit() before the main thread exits.N)rMrKEXITINGwarningswarnRuntimeWarningrArs r _clean_exitzBus._clean_exitsH :: ' MM%(,zz24B  C IIK (rctj|jtj|_|j d |jdtj|_|j dy #ttf$rt$rO|j dddtjd} |j|#t$rY|wxYwwxYw) zStart all services.z Bus STARTINGr?z Bus STARTEDz-Shutting down due to error in start listener:rdTrerN)atexitregisterrzrKSTARTINGrMrCrtSTARTEDrkrlrnrrrA)r e_infos rr?z Bus.starts(()__     LL !DJ HH] #!:.    HHD  /\\^A&F  L  L   s17A??AC&CC& C"C&!C""C&cl|j}d} |jtj|_|j d|j d|j d|tjk(rtj|yy#t $rtj|YJwxYw)z2Stop all services and prepare to exit the process.Fz Bus EXITINGrAz Bus EXITEDN) rMr@rKrvrCrtrnos_exitr~)r exitstate EX_SOFTWAREs rrAzBus.exitsJJ   " IIKDJ HH] # LL  HH\ "  ' HH[ ! ( " HH[ !  "sABB32B3c2d|_|jy)zRestart the process (may close connections). This method does not restart the process from the calling thread; instead, it stops the bus and asks the main thread to call execv. TN)rJrArs rrestartz Bus.restart7s  rcH|jd|jdy)zAdvise all services to reload.z Bus gracefulrBN)rCrtrs rrBz Bus.gracefulAs   Z rct |jtj|d|j dtjD]p}|tjk7st|tjr6|jrC|j d|jz|jr|j r|j#yy#ttf$r$|j d|j Yt$r#|j d|j wxYw)aWait for the EXITING state, KeyboardInterrupt or SystemExit. This function is intended to be called only by the main thread. After waiting for the EXITING state, it also waits for all threads to terminate, and then calls os.execv if self.execv is True. This design allows another thread to call bus.restart, yet have the main thread perform the actual execv call (required on some platforms). rD)intervalrHz%Keyboard Interrupt: shutting down busz$SystemExit raised: shutting down busz)Waiting for child threads to terminate...zWaiting for thread %s.N)waitrKrvrkIOErrorrCrArl threading enumeratecurrent_threadr6 _MainThreaddaemonr1rrJ _do_execv)r rts rblockz Bus.blockFs  IIfnnxI H <=$$& A 1133"1i&;&;<1AFF:;  :: NN  ?"7+  HH< = IIK  HH; < IIK  s"C0D7 +D7ctt|}|j|vr6tj||j ||j|vr5yy)z=Poll for the given state(s) at intervals; publish to channel.N)rFrrMtimesleeprt)r rMrrHrKs rrzBus.waittsC_U+,jj& JJx LL !jj&rct |j}|j ddj|z|jtjtjdddk(rddl m }|tjdk(r|Dcgc]}d |z }}tjt|j r|j#tj$tj|y#t$r8 tjg|j ztj z}YwxYwcc}w) zRe-execute the current process. This must be called from the main thread, because certain platforms (OS X) don't allow execv to be called in a child thread very well. zRe-spawning %s Njavar) SystemRestartwin32z"%s")_get_true_argvNotImplementedErrorr executable_get_interpreter_argvargvrCr_extend_pythonpathrenvironplatform_systemrestartrchdir _startup_cwdmax_cloexec_files _set_cloexecrJ)r r rargs rrz Bus._do_execv|s N&&(D !CHHTN23  + << v % 4 ||w&045 55 HH\ "%%!!# HHS^^T *%# N -NN#d&@&@&BBSXXMD N6sC1 D51=D21D2cPttddrgStjS)aRetrieve current Python interpreter's arguments. Returns empty tuple in case of frozen mode, uses built-in arguments reproduction function otherwise. Frozen mode is possible for the app has been packaged into a binary executable using py2exe. In this case the interpreter's arguments are already built-in into that executable. :seealso: https://github.com/cherrypy/cherrypy/issues/1526 Ref: https://pythonhosted.org/PyInstaller/runtime-information.html frozenF)rZr subprocess_args_from_interpreter_flagsr2rrrzBus._get_interpreter_argvs-3%0 @<<> @rc tj}tj|}tj}tjj tj |tj ||d|j}t|dd}}} |jd}||dz kr ||dzdvr d} |jd}||dz kr ||dzdk(rd}|r |r||kr tdtjd } tj | tj"s t%d j'| |||d z=|j)|| |S|r td |S#ttf$rd}YwxYw#ttf$rd}YwxYw#t$$r t*wxYw) a(Retrieve all real arguments of the python interpreter. ...even those not listed in ``sys.argv`` :seealso: http://stackoverflow.com/a/28338254/595220 :seealso: http://stackoverflow.com/a/6683222/595220 :seealso: http://stackoverflow.com/a/28414807/595220 NF-mr)-crTrz[Cannot reconstruct command from '-c'. Ref: https://github.com/cherrypy/cherrypy/issues/1545rz9{} doesn't seem to be a module accessible by current user)ctypes c_wchar_pPOINTERc_int pythonapiPy_GetArgcArgvbyrefr:lenindex IndexError ValueError RuntimeErrorrrraccessR_OKAttributeErrorformatinsertr) char_prargc_argvargv_len is_command is_modulem_indc_indoriginal_modules rrzBus._get_true_argvsI %%F)6>>&)+D<<>D    + + T" T"  $**%E/2%j%)jH  D)8a<'E%!),< ,L!%I  D)8a<'E%!),<,D!%JD%%-5&KLL#&((1+yy"'':7(55;VO5LNN% /* UO4$L#I"LMM"LY +   +  2 & & % &sUB"F5%&F &F2BF56F5FF5FF5F2/F51F22F55Gcdtjz}|jdd}tjddk(xr|j | }|r ||z|d<yy)a;Prepend current working dir to PATH environment variable if needed. If sys.path[0] is an empty string, the interpreter was likely invoked with -m and the effective path is about to change on re- exec. Add the current directory to $PYTHONPATH to ensure that the new process sees the same path. This issue cannot be addressed in the general case because Python cannot reliably reconstruct the original command line ( http://bugs.python.org/issue14208). (This idea filched from tornado.autoreload) . PYTHONPATHrN)rpathsepr^rpath startswith)env path_prefix existing_path needs_patchs rrzBus._extend_pythonpathsfBJJ&  b1 HHQK2  6((5 5   +m ;C  rctd|jD]]} tj|tj}tj|tj |tj z_y#t$rYlwxYw)aSet the CLOEXEC flag on all open files (except stdin/out/err). If self.max_cloexec_files is an integer (the default), then on platforms which support it, it represents the max open files setting for the operating system. This function will be called just before the process is restarted via os.execv() to prevent open files from persisting into the new process. Set self.max_cloexec_files to 0 to disable this behavior. N)rangerfcntlF_GETFDrF_SETFD FD_CLOEXEC)r fdflagss rrzBus._set_cloexecsp4112 EB  B 6 KKEMM553C3C+C D  E  s$A88 BBctj|_|jd|j dtj |_|jdy)zStop all services.z Bus STOPPINGr@z Bus STOPPEDN)rKSTOPPINGrMrCrtrLrs rr@zBus.stop+s<__    V^^  rc|d}|i}|f|z}fd}tj|||}d|jz|_|jj|S)z?Start 'func' in a new thread T, then start self (and return T).r2cTjtj||i|yr5)rrKr)funcakwr s r _callbackz*Bus.start_with_callback.._callback;s IIfnn % !NrNr)targetr rz Bus Callback )rThreadr1r?)r rr rrrs` rstart_with_callbackzBus.start_with_callback3sd <D >Fw~    ID H 166)   rc|r9|ddjtjtjzz }|j d||y)zPLog the given message. Append the last traceback if requested. rrrCN)r _tracebackformat_exceptionrrrt)r msgrfrgs rrCzBus.logFs@  4"''*"="=s||~"NOO OC UC'r)NN)皙?)rN)rF)r%r&r'r(rKrLrMrJ max_filesrr rWr`rtrzr?rArrBrrr staticmethodrrrrr@rrCr2rrr=r=sF NNE E! 9(6"H0"6! ,\"+:@@"RRh<<0E$ &(rr=)#r(r|r ImportErrorrirrrrrgrrwrrUmore_itertoolsrgetcwdrrnrr7r-rKr3rLr~rrrvrsysconfrrr=busr2rrrs(;z  *ryy{ iB - - ,,.,,.BJJ}- l(&l(^  e]F v   Is5C8DD8DDDDDD