File: //opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/__pycache__/schedule.cpython-310.pyc
o
�N�gH � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
ZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddlZddl Zddl Zddl Zddl Zddl Zddlm!Z! ddl"m#Z# z ddl$m%Z& dZ'dZ(W n
e)y� dZ'dZ(Y nw zddl*Z*dZ+W n e)y� dZ+Y nw e�,e-�Z.G dd� d�Z/d d
� Z0dS ) a\
Scheduling routines are located here. To activate the scheduler make the
``schedule`` option available to the master or minion configurations (master
config file or for the minion via config or pillar).
Detailed tutorial about scheduling jobs can be found :ref:`here
<scheduling-jobs>`.
Requires that python-dateutil is installed on the minion.
� N)�SaltInvocationError)� OrderedDictTFc @ sV e Zd ZdZdZ d@dd�Z d@dd�Z dAdd �Zd
d � Zd d
� Z dBdd�Z
dd� Z dd� Z dCdd�Z
dd� ZdCdd�ZdCdd �ZdCd d �ZdCd d �ZdCd!d"�Zd#d$� ZdCd%d&�ZdCd'd(�Zd)d*� ZdDd+d,�ZdDd-d.�ZdDd/d0�ZdDd1d2�ZdEd4d5�Z dFd6d7�Z dGd8d9�Z dGd:d;�Z dGd<d=�Z d>d?� Z!dS )H�SchedulezR
Create a Schedule object, pass in the opts and the functions dict to use
NFc C sj | j du s |du r-t�d� t�| �} | j|||||||| |
d� |du r'| S | | _ | j S t�d� | j S )z6
Only create one instance of Schedule
NTzInitializing new Schedule)� returners� intervals�cleanup�proxy�
standalone�utils�_subprocess_listzRe-using Schedule)�instance�log�debug�object�__new__�__singleton_init__) �cls�opts� functionsr r r r r � new_instancer
r r � r �G/opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/schedule.pyr M s(
�
�zSchedule.__new__c C s d S �Nr ) �selfr r r r r r r r r
r r r r �__init__v s
zSchedule.__init__c
C s || _ || _|| _|ptj�|�| _|| _d | _d | _d | _ d| _
t |t �r*|| _
ni | _
| js?t|d�r9|| _n|j�� | _z
| j�ddd� �� | _W n ty` tjdtjd� d| _Y nw | �d �| _tj| _ | jsrt |� |r~|D ]}
| � |
� qv| d u r�tjj � � | _!d S | | _!d S )
NT� __getitem__ztimezone.get_offsetc S s dS )N�0000r r r r r �<lambda>� s z-Schedule.__singleton_init__.<locals>.<lambda>z<Unable to obtain correct timezone offset, defaulting to 0000�Zexc_info_on_loglevelr �schedule_returner)"r r r �salt�loaderr
r �
skip_function�skip_during_range�splay�enabled�
isinstance�dictr �hasattrr Z
gen_functions�get� time_offset� Exceptionr
�warning�logging�DEBUG�optionr �sys�maxsize�
loop_interval�clean_proc_dir�delete_job_prefix�processZSubprocessListr ) r r r r r r r r r
r �prefixr r r r � sJ
� �
�
zSchedule.__singleton_init__c C s | j | j| j| jd fS r )r r r r �r r r r �__getnewargs__� s zSchedule.__getnewargs__c C s, d| j v r| j d |i dd�S | j�|i �S )z>
Return options merged from config and pillar
z config.mergeT)Z omit_master)r r r) )r �optr r r r/ � s
zSchedule.optionTc
C s� i }|r | j �di ��di �}t|t�std��|�|� |r4| j �di �}t|t�s/td��|�|� |rZt�|�}|D ]}t|| t�rW|| D ] } | �d�rV|| | = qJq=|S |S )�4
Return the schedule data structure
�pillar�schedule� Schedule must be of type dict.�_) r r) r& r' �
ValueError�update�copy�deepcopy�
startswith)
r � include_opts�include_pillar�
remove_hiddenr< Zpillar_scheduleZ
opts_scheduleZ _schedule�job�itemr r r �
_get_schedule� s*
�zSchedule._get_schedulec C s d|vs|d s
|S d|vs|d rd}| j d dkr$tjj�| j �}ntjj�| j �}|D ]P}d|v r~t�d||� |d |d kr~tjj �
|d �r~|d
7 }t�d ||d � ||d kr~t�d
|d |d � d |d< d|d< ||d< d|d< | S q.|S )r: �run� jid_includer �__role�masterr< z5schedule.handle_func: Checking job against fun %s: %s�name�pid� zEschedule.handle_func: Incrementing jobcount, now %s, maxrunning is %s�
maxrunningzNschedule.handle_func: The scheduled job %s was not started, %s already running� _skip_reasonT�_skipped�
_skipped_timeF) r r r
rM Zget_running_jobs�minionZrunningr
r r5 �
os_is_running)r �func�datar �nowZjobcountZ current_jobsrG r r r �_check_max_running� sL ���� ��zSchedule._check_max_runningc
C s( | j �dd�}|du rd| j v rtj�| j d �}|du r!tjj}tj�|tj�| j �dtj j
d ���}tj� |�s@t� |� tj�|d�}t
�d� | jddd �}z.tjj�|d
��}|�tjj�tjj�d |i��� W d � W dS 1 szw Y W dS ty� t
jd tjd
� Y dS w )ze
Persist the modified schedule into <<configdir>>/<<default_include>>/_schedule.conf
Zconf_dirNZ conf_fileZdefault_includez_schedule.confzPersisting scheduleFT)rE rF zwb+r< z&Failed to persist the updated scheduler ) r r) �os�path�dirnamer ZsyspathsZ
CONFIG_DIR�joinZconfigZDEFAULT_MINION_OPTS�isdir�makedirsr
r rI r
�files�fopen�writeZ stringutils�to_bytesZyamlZ safe_dump�OSError�errorr- r. )r Z
config_dirZ minion_d_dirZ
schedule_confZ
schedule_data�fp_r r r �persist sB
���
��&� ��zSchedule.persistc C s� || j d v r| j d |= n|| jdd�v r t�d|� |rEtjjjd| j dd��}|jd| �� d�d d
� W d � n1 s@w Y || j v rN| j |= |rV| �
� d S d S ) zK
Deletes a job from the scheduler. Ignore jobs from pillar
r< F�rD �)Cannot delete job %s, it's in the pillar!rU �r �listenT��completer< �,/salt/minion/minion_schedule_delete_complete��tagN) r rI r
r, r r
�event� get_event�
fire_eventr rh �r rN rh rt �evtr r r �
delete_job> s& � � �
�zSchedule.delete_jobc C s& d| _ d| _d| _d| _i | jd< dS )z1
Reset the scheduler to defaults
NTr< )r" r# r% r$ r r7 r r r �resetY s
zSchedule.resetc C s� t | jd �� �D ]
}|�|�r| jd |= q | jdd�D ]
}|�|�r*t�d|� q |rTtjj j
d| jdd��}|j d| �� d�d d
� W d � n1 sOw Y t | j �� �D ] }|�|�rf| j |= q[|ro| �
� d S d S ) zL
Deletes a job from the scheduler. Ignores jobs from pillar
r< Fri rj rU rk Trm ro rp N)�listr �keysrC rI r
r, r r
rr rs rt r rh )r rN rh rt rG rv r r r r4 c s2
�
�� � �
� �zSchedule.delete_job_prefixc C s$ t |t�s td��t|�dkstd��|D ]}d|| vr#d|| d< qtt|�� ��}|| jdd�v r;t� d|� n$|| j
d v rQt� d
|� | j
d � |� nt� d |� | j
d � |� |r�t
jjjd | j
dd
��}|jd| �� d�dd� W d � n1 s�w Y |r�| �� dS dS )z�
Adds a new job to the scheduler. The format is the same as required in
the configuration file. See the docs on how YAML is interpreted into
python data-structures to make sure, you pass correct dictionaries.
z'Scheduled jobs have to be of type dict.rP z,You can only schedule one new job at a time.r% TFri z)Cannot update job %s, it's in the pillar!r< z+Updating job settings for scheduled job: %sz Added new job %s to schedulerrU rk rm z)/salt/minion/minion_schedule_add_completerp N)r& r' r? �len�next�iterrz rI r
r, r �infor@ r r
rr rs rt rh )r rX rh rt rG Znew_jobrv r r r �add_job� s:
� � � � �zSchedule.add_jobc C s� || j d v rd| j d | d< t�d|� n|| jdd�v r%t�d|� |rNtjjjd| j dd ��}|j d| �� d
�d d � W d
� n1 sIw Y |rV| �
� d
S d
S )zI
Enable a job in the scheduler. Ignores jobs from pillar
r< Tr% z Enabling job %s in schedulerFri �)Cannot modify job %s, it's in the pillar!rU rk rm z1/salt/minion/minion_schedule_enabled_job_completerp N� r r
r~ rI r, r r
rr rs rt rh ru r r r �
enable_job� s$ � � � �zSchedule.enable_jobc C s� || j d v rd| j d | d< t�d|� n|| jdd�v r%t�d|� |rNtjjjd| j dd��}|j d | �� d
�d d � W d
� n1 sIw Y |rV| �
� d
S d
S )zJ
Disable a job in the scheduler. Ignores jobs from pillar
r< Fr% z Disabling job %s in schedulerri r� rU rk Trm z2/salt/minion/minion_schedule_disabled_job_completerp Nr� ru r r r � disable_job� s$ � � � �zSchedule.disable_jobc C s` || j d v r| �|||� n|| jdd�v r t�d|� dS || j d |< |r.| �� dS dS )zI
Modify a job in the scheduler. Ignores jobs from pillar
r< Fri r� N)r rw rI r
r, rh )r rN r< rh rt r r r �
modify_job� s �zSchedule.modify_jobc C s� | � � �|i �}d|v r|d }nd|v r|d }n d|v r#|d }nd}|| jvr1t�d||� d|vr9||d< d|vrAd|d< | jsP| �||| jtj� � �}|�d�rct�d |� | �
||� dS dS )
z(
Run a schedule job now
�functionrW �funN�)Invalid function: %s in scheduled job %s.rN rJ TzRunning Job: %s) rI r) r r
r~ r rZ r �datetimerY �_run_job)r rN rX rW r r r �run_job� s,
�
�zSchedule.run_jobc C st d| j d d< |r0tjjjd| j dd��}|jd| �� d�dd � W d
� n1 s+w Y |r8| �� d
S d
S ) z'
Enable the scheduler.
Tr< r% rU Frk rm z-/salt/minion/minion_schedule_enabled_completerp N�r r r
rr rs rt rI rh �r rh rt rv r r r �enable_schedule � � � � �zSchedule.enable_schedulec C st d| j d d< |r0tjjjd| j dd��}|jd| �� d�dd � W d
� n1 s+w Y |r8| �� d
S d
S ) z(
Disable the scheduler.
Fr< r% rU rk Trm z./salt/minion/minion_schedule_disabled_completerp Nr� r� r r r �disable_schedule$ r� zSchedule.disable_schedulec C s. i | _ d|v r |d }| j�di ��|� dS )z?
Reload the schedule from saved schedule file.
r< N)r r �
setdefaultr@ )r r< r r r �reload7 s zSchedule.reloadc C s� |dkr | j dd�}n|dkr| j dd�}n| � � }|rDtjjjd| jdd��}|jd|d �d
d � W d � d S 1 s=w Y d S d S )
z1
List the current schedule items
r; Fri r )rE rU rk Trm z*/salt/minion/minion_schedule_list_completerp N)rI r r
rr rs r rt )r �wherert r< rv r r r ry B s ��"��z
Schedule.listc C s^ | � � |r-tjjjd| jdd��}|jddidd� W d � dS 1 s&w Y dS dS ) z+
Save the current schedule
rU Frk rn Tz"/salt/minion/minion_schedule_savedrp N)rh r r
rr rs r rt )r rt rv r r r �
save_scheduleW s ��"��zSchedule.save_schedulec C s( |d }|d }|� dd�}|| jd v rXd| jd | vr'g | jd | d< | jd | d �||d�� d| jd | vrHg | jd | d< | jd | d �||d�� n|| jd d
�v rft�d |� |r�tjjj d | jd d
��}|j
d| �� d�dd� W d � dS 1 s�w Y dS dS )zS
Postpone a job in the scheduler.
Ignores jobs from pillar
�time�new_time�time_fmt�%Y-%m-%dT%H:%M:%Sr< �
skip_explicit�r� r� � run_explicitFri r� rU rk Trm z2/salt/minion/minion_schedule_postpone_job_completerp N� r) r �appendrI r
r, r r
rr rs rt )r rN rX rt r� r� r� rv r r r � postpone_jobf s6 �� � �"��zSchedule.postpone_jobc C s� |d }|� dd�}|| jd v r3d| jd | vr#g | jd | d< | jd | d �||d�� n|| jdd�v rAt�d |� |rmtjjj d
| jdd ��}|j
d | �� d
�dd� W d � dS 1 sfw Y dS dS )zb
Skip a job at a specific time in the scheduler.
Ignores jobs from pillar
r� r� r� r< r� r� Fri r� rU rk Trm z./salt/minion/minion_schedule_skip_job_completerp Nr� )r rN rX rt r� r� rv r r r �skip_job� s* � � �"��zSchedule.skip_jobr� c C s� | � � }d}|r|�|i ��dd�}|r|�|�}|rCtjjjd| jdd��}|jd|d�dd � W d � dS 1 s<w Y dS dS )
zA
Return the next fire time for the specified job
N�_next_fire_timerU Frk T)rn Znext_fire_timez4/salt/minion/minion_schedule_next_fire_time_completerp ) rI r) �strftimer r
rr rs r rt )r rN �fmtrt r< r� rv r r r �get_next_fire_time� s"
��"��zSchedule.get_next_fire_timec C s| |r4| � � }|�|i �}tjjjd| jdd��}|jd|d�dd� W d � dS 1 s-w Y dS | � � }|�|i �S ) z4
Return the specified schedule item
rU Frk T)rn rX z0/salt/minion/minion_schedule_job_status_completerp N)rI r) r r
rr rs r rt )r rN rt r< rX rv r r r �
job_status� s ��"� zSchedule.job_statusc ! C s
t jj�� s| j�d�dkrCt j�| j�| _| jd dkr)t jj| j| jd�| _n
t jj | j| j
| jd�| _t jj | j| j| j
d�| _ |du rOt jj �
| j�}| j�d d�|g |d
|d �}d |v r�t|d t�r�|d |d < | j|d d
< t�� |d d< t�dt�� �|d d< nt�d� |�dd�}| js�tj�t j� | jd �|d �}�zP�zd}| j�di ��dd�r�| j�di ��dg �} |dkr�|| vr�d}n | j�di ��dd�r�| j�di ��dg �} |dkr�|| vr�d}|r�t d ��t� � |d < t � }
d |v �rt �!|d �}
|d �"|d � i } d |v �r,t �!|d �} |d �#t �!| �� || jv�rF| j�$|�|d!< t jj%j&| j�$|�d"� | j�s|d#|v�sT|d# �r|t�'d$|� t jj(�)|d%��} | �*t j+�,|�� W d � n 1 �sww Y t jj-�.| j| �}
|
j/�r�|�0� D ]\}}|d k�r�t �!|�| d&|� �< �q�| jd dk�r)t jj �
| j�}t jj1j2|d'd(�}t jj1j3t jj1j4| jd | jd) | jdd*�|dd+�}|t jj5�6� |t7�
|�d,�}t � | j�}t jj8�9||� g }|�:� D ]0}d-|v�r�q�|�;d-d.�\}}||v �r�q�|�#|� |�0� D ]
\}}|| j| j<|< �q�q�d/| jj=d0 d1< | j| |
i | ��|d!< | j�s�d1| jj=d0 v �rT| jj=d0 d1 |d1< d|d2< |�s_| j>�r�d3|v �rj|d3 |d4< d5|v �ru|d5 |d6< g }|| j>fD ]}t|t?��r�|�#|� �q|t|t@��r�|�"|� �q|tA�B|�D ] }|� d7�} | | j v �r�| j | |� �q�t�Cd8||� �q�W n( tD�y� t�Ed9|d: � d!|v�r�d;�F|d: �|d!< d|d2< d<|d1< Y nw W d| jv �r�| jd d=v �r�d>|v �r |d> �s n�|� � } |�s| j>�sd?| d< |�d>�d@k�rd@| d< dA| jd dB�} | �0� D ] \}}|| |< �q'd| jv �rK| jd dCk�rKt jj1j4dC| jdd*�} nd| jv �re| jd dk�ret jj1�G| j| jd) �} z'z| �H| dD� W n tD�y� } z t�EdE� W Y d} ~ nd} ~ ww W | �I� n| �I� w | jd dk�r�|�I� | j�s�t�'dF|� zCzt�J|� W n+ tK�y� } z | jLtLjMk�s�| jLtLjNk�r�n t�%dG|| jL� � W Y d} ~ nd} ~ ww W |�r�tO�Pt jQjRjS� dS dS |�r�tO�Pt jQjRjS� w w dS d| jv �r�| jd d=v �r�d>|v �r|d> �sn�|� � } |�s/| j>�s/d?| d< |�d>�d@k�r/d@| d< dA| jd dB�} | �0� D ] \}}|| |< �q;d| jv �r_| jd dCk�r_t jj1j4dC| jdd*�} nd| jv �ry| jd dk�ryt jj1�G| j| jd) �} z'z| �H| dD� W n tD�y� } z t�EdE� W Y d} ~ nd} ~ ww W | �I� n| �I� w | jd dk�r�|�I� | j�s t�'dF|� zAzt�J|� W n+ tK�y� } z | jLtLjMk�s�| jLtLjNk�r�n t�%dG|| jL� � W Y d} ~ nd} ~ ww W |�r�tO�Pt jQjRjS� w w |�r
tO�Pt jQjRjS� w w w )HzA
Execute this method in a multiprocess or thread
Z transportZzeromqrL rM )r
)r r
)r N�idrN )r� r� �fun_argsr< �jid�metadataZ_TOSZ_TSz%Y %B %d %a %H %mZ_TTzNschedule: The metadata parameter must be specified as a dictionary. Ignoring.�returner�cachedirr� Fr; Zminion_blackoutZminion_blackout_whitelistzsaltutil.refresh_pillarT�grainsz�Minion in blackout mode. Set 'minion_blackout' to False in pillar or grains to resume operations. Only saltutil.refresh_pillar allowed in blackout mode.rO �argsr� �kwargs�return)�messagerK zBschedule.handle_func: adding this job to the jobcache with data %szw+bZ__pub_zsalt/scheduler/)r6 Zsock_dirrk )Z
print_func)Z__jid__Z__user__Z__tag__Z
__jid_event__�.rP r � __context__�retcode�successZ
return_configZ
ret_configZ
return_kwargsZ
ret_kwargsz .returnerz,Job %s using invalid returner: %s. Ignoring.z Unhandled exception running %sr� z Unhandled exception running {}� )rM rU Z
return_jobZreqZnocacheZ_return)�cmdr� rU Z__schedule_returnz2Unhandled exception firing __schedule_return eventz!schedule.handle_func: Removing %szFailed to delete '%s': %s)Tr r
�platform�spawning_platformr r) r! Zrunnerr Z minion_modsr r r� �gen_jidr& r' r* r� �ctimer� �gmtimer
r, r r[ r\ r^ rU � get_proc_dirr �getpid�tuplerA rB �extendr� Zmissing_fun_stringrf Z raise_errorr ra rb rc �payload�dumpsr� Zget_function_argspec�keywords�itemsrr ZtagifyZNamespacedEventrs �userZget_user�weakrefZlazyZ
verify_funrz �split� __globals__�packr �strry r �fromkeysr~ r+ � exception�formatZget_master_eventrt Zdestroy�unlinkre �errnoZEEXIST�ENOENTr0 �exit�defaultsZ exitcodesZ
EX_GENERIC)!r �multiprocessing_enabledrW rX r� �retZ
data_returnerZproc_fnZminion_blackout_violationZ whitelistr� r� rg Zargspec�key�valrq Znamespaced_eventZ func_globalsZself_functionsZcompleted_funcs�mod_name�modr> Z
global_key�valueZretsr� Zret_strZmret�loadrr �excr r r � handle_func� s�
� � � � �� �����
�� �
���
�
�
�
��
�� � ����� ����
��� � � ����� ���� ���zSchedule.handle_funcc sd t �d�� g }�jd }t|tj�stj|d�}dd� }��fdd�}�fdd �}���fd
d �}��fd d
�}�fdd�} ��fdd�}
��fdd�} ��fdd�} �fdd�}
�fdd�}dd� }��� }t|t�sqtd ��d |v rz|d �_ d |v r�|d �_
d |v r�|d �_ d |v r�|d �_ g d!�}|�
� D �]\}� ||v r�q�d"D ] }|� v r�� |= q�d#�d$� v r�� d$ }n| }� d$< t� t�s�t �d%|t� �� q�d&� v r܈ d& }nd'� v r� d' }n d(� v r� d( }nd)}|�jvr�t �d*||� d+� v�rd)� d+< d,� v�rd)� d,< d-� v �r!� d- �r!d.� v�r!d/� d.< ��s)tj�� �t� �� ��d0}d1}d2d3� t�|d4�D �}t�fd5d6�|D ���rTt �d7d8�|�� q�g }|D ]}t�|g|�}|�tt�|d4��� �qXt�fd9d6�|D ���r�t �d:d8�|�d8�|�� q�d;� v �r�| � |� � d< �d/� fd=d3�|D �v �r�|� � n"d>� v �r�|� |� nd?� v �r�|� |� n d@� v �r�|� |� nq�dA� v �rԈ dA �r�q�dB� v �r߈ dB �r�q�t|� d+ �|�� � � �}d � v�r��j � d < d � v �rO� d �rO� d, �s7|� d �} �� d+ tj| d� k �r5t � dC| � � d+ tj| d� � d,< d?� v �r4d/� dD< nd/�� d, �rO� d, � � � }d?� v �rO� d, � d+< dE� v �r\|dFk�r[d/�nYd?� v �r�� dD �r�� d+ � k�rx� d+ | k�r�n n;d#� dD< d/�n4d@� v �r�|dFk�r�d)� d+< d/�n#d>� v �r�� d+ � k�r�� d+ | k�r�n n
d/�n|dFk�r�d/�d.� v �rƈ d. �r�d/�d#� d.< n���rqdG� v �r�| � � dB� v �r݈ dB �r�q�� d< �d'� v �r� d' }d � v�r��j
�r��j
� d < d � v �r � d �r | � |� dB� v �r� dB �rq�� d< �d'� v �r � d' }dH� v �rA|
� |� dB� v �r4� dB �r4q�� d< �d'� v �rA� d' }dI� v �rY|� � dB� v �rU� dB �rUq�� d< �dJ� v �rq|
� � dB� v �rm� dB �rmq�� d< �dA� v �r}� dA �r}d#��j �r�� � d d/��s�t �dK|� dL� dM< �� dN< d/� dO< d#�dP} |dFk �r�dQt |�� dR�} z���r�dS� v�s�� dS �r�d/� dS< t � dT|� dU� v �r�t � dV|� dU � n
t �dW|� dX� dU< �j �s�� d<< ��!|� �j��� � d< ���rt"j#j$�%�j�} |�| � t �dY|| | � �j&|� | dZ� W ��r �� d[< d)� d,< dE� v �r`�j �r3�tj� dE d� � d+< q�dO� v �rQ� dO �rQ� d+ �k�rP�tj� dE d� � d+< q���r`�tj� dE d� � d+< q���rl�� d[< d)� d,< dE� v �r��j �r��tj� dE d� � d+< w dO� v �r�� dO �r�� d+ �k�r��tj� dE d� � d+< w ��r��tj� dE d� � d+< w |S )\z�
Evaluate and execute the schedule
:param datetime now: Override current time with a datetime object instance``
z%==== evaluating schedule now %s =====r2 ��secondsc S sT d}t | t�r"| d | d krt�| d | d �}|S t�d� |S t�d| �}|S )z-
Calculate splaytime
N�end�startzSschedule.handle_func: Invalid Splay, end must be larger than start. Ignoring splay.rP )r& r' �random�randintr
rf )Z splaytimeZsplay_r r r �_splay� s
�� �z Schedule.eval.<locals>._splayc s� d| vrZt | �dd��}|t | �dd��d 7 }|t | �dd��d 7 }|t | �dd��d 7 }|| d< | d
sD� tj| d d � | d
< |�jk rL|�_� tj| d d � | d < d
S d
S )zk
Handle schedule item with time elements
seconds, minutes, hours, days
�_secondsr� r �minutes�< �hoursi �daysi�Q r� r� �_next_scheduled_fire_timeN)�intr) r� � timedeltar2 )rX �interval�rY r r r �_handle_time_elements� s �
��z,Schedule.eval.<locals>._handle_time_elementsc s� | d r| d � | k s| d � kr| d sd| d< | d sr| d st| d }t |tj�s^| �dd�}z tj�| d |�}W n ttfy] d�| d || d �| d
< t�| d
� Y d S w || d< || d < |� | k rvd| d< d S d S d S d S )
z8
Handle schedule item with once
r� r� T� _continue�once�once_fmtr� z9Date string could not be parsed: {}, {}. Ignoring job {}.rN �_errorNr� ) r& r� r) �strptime� TypeErrorr? r� r
rf )rX r2 r� r� �rY r r � _handle_once s6 � ���
�z#Schedule.eval.<locals>._handle_oncec s� t sd�| d �| d< t�| d � dS t| d t�s!| d g}n| d }g }|D ]�}d�jv rgd�jd v rg|�jd d v rgt�jd d t�s]d�| d �| d< t�| d � dS �jd d | }n>d �jv r�d�jd v r�|�jd d v r�t�jd d t�s�d
�| d �| d< t�| d � dS �jd d | }n|}t|tj�s�zt �
|�}W n t y� d �|| d �| d< t�| d � Y dS w |� |� q)| d r�|� | d � |�
� t�|�D ]}t|�d
kr�|� | k r�|�|� q�|�r_|d }|� | k �r$| �dd��s$��s$| d �s$d| d< d| d< dS d| v�r3t|� | k�| d< | d �s<|| d< || d< | d |k �rY��s[| d �s]|| d< d| d< dS dS dS dS | �dd��spd| d< d| d< dS dS )z8
Handle schedule item with when
�)Missing python-dateutil. Ignoring job {}.rN r� N�whenr; Zwhensz4Pillar item "whens" must be a dict. Ignoring job {}.r� z.Grain "whens" must be a dict. Ignoring job {}.z(Invalid date string {}. Ignoring job {}.r� rP r �_runFr� Tr� r� )�_WHEN_SUPPORTEDr� r
rf r& ry r r' r� �dateutil_parser�parser? r� �sortrA rB r{ �remover) �bool)rX r2 Z
_when_dataZ_when�iZwhen_r� )rY rJ r r r � _handle_when1 s� �
�
�� ���
�
���
� �z#Schedule.eval.<locals>._handle_whenc s� t sd�| d �| d< t�| d � dS | d du rkz t�| d � ��tj�| d< t�| d � ��tj�| d< W n ttfyT d�| d �| d< t�| d � Y dS w � | d � � }|d krm|�j
k ro|�_
dS dS dS dS )
z8
Handle schedule item with cron
z)Missing python-croniter. Ignoring job {}.rN r� Nr� �cronr� z%Invalid cron string. Ignoring job {}.r� ) �_CRON_SUPPORTEDr� r
rf �croniterZget_nextr� r? �KeyError�
total_secondsr2 )rX r2 r� r� r r � _handle_cron� s< � ���
���
�z#Schedule.eval.<locals>._handle_cronc s� g }| d D ] }t |tj�r|�|� q|�tj�|d |d �� qd| d< t�|�D ]}t|�dkr?|� | k r?|�|� q,|ra|d � krR|d | k rcn d
S d| d< |d | d < d
S d
S d
S ) z@
Handle schedule item with run_explicit
r� r� r� FrJ rP r Tr� N)r& r� r� r� rA rB r{ r� )rX r2 Z
_run_explicitZ _run_timer� r� r r �_handle_run_explicit� s* ��
�&�z+Schedule.eval.<locals>._handle_run_explicitc s� d| d< g }| d D ] }t |tj�r|�|� q
|�tj�|d |d �� q
t�|�D ]
}|� | k r9|�|� q,|rq|d � krL|d | kron d S �jr]d| d< �j| d< d S d| d < � | d
< d| d < d| d< d S d S d| d< d S )
�A
Handle schedule item with skip_explicit
FrJ r� r� r� r TrW rR rT rS N)r& r� r� r� rA rB r� r" )rX r2 Z_skip_explicitZ
_skip_timer� r� r r �_handle_skip_explicit� s2 ��
�& �
z,Schedule.eval.<locals>._handle_skip_explicitc s� t sd�| d �| d< t�| d � dS t| d t�s-d�| d �| d< t�| d � dS | d d }| d d }t|tj�sazt�|�}W n t y` d �| d �| d< t�| d � Y dS w t|tj�s�zt�|�}W n t y� d
�| d �| d< t�| d � Y dS w d | v r�| d r�d | vr�g | d < || �
d
�}|| d vr�| d � |d
d�� ||kr�|� kr�|kr�n n �j r�d| d< �j | d< dS d| d< � | d< d| d< d| d< dS d| d< dS d�| d �| d< t�| d � dS )r r� rN r� Nr# zXschedule.handle_func: Invalid, range must be specified as a dictionary. Ignoring job {}.r� r� zDInvalid date string for start in skip_during_range. Ignoring job {}.zBInvalid date string for end in skip_during_range. Ignoring job {}.Zrun_after_skip_ranger� r� r� TrJ rW �
in_skip_rangerR rT rS F�Tschedule.handle_func: Invalid range, end must be larger than start. Ignoring job {}.)
�_RANGE_SUPPORTEDr� r
rf r& r' r� r� r� r? r� r� r" )rX r2 r� r� Z_run_immediater� r r �_handle_skip_during_range sp �
�
��
�� �
�z0Schedule.eval.<locals>._handle_skip_during_rangec s� t sd�| d �| d< t�| d � dS t| d t�s-d�| d �| d< t�| d � dS | d d }| d d }t|tj�sazt�|�}W n t y` d �| d �| d< t�| d � Y dS w t|tj�s�zt�|�}W n t y� d
�| d �| d< t�| d � Y dS w ||kr�d | d v r�| d d r�� |ks�� |kr�d | d
< dS d| d< d| d
< dS |� kr�|kr�n nd | d
< dS �j
r�d | d
< �j
| d< dS d| d< d| d
< dS d�| d �| d< t�| d � dS )r �(Missing python-dateutil. Ignoring job {}rN r� N�rangezWschedule.handle_func: Invalid, range must be specified as a dictionary.Ignoring job {}.r� r� z/Invalid date string for start. Ignoring job {}.z-Invalid date string for end. Ignoring job {}.�invertTrJ r rR FrW Z not_in_ranger ) r
r� r
rf r& r' r� r� r� r? r" )rX r� r� r� r r �
_handle_rangeO sj �
� ��� ���
�z$Schedule.eval.<locals>._handle_rangec s� t sd�| d �| d< t�| d � dS | d }t|tj�s#t�|�}|� krAt�d| d � d| d< � | d < d
| d < d | d
< dS d
| d
< dS )z9
Handle schedule item with after
r rN r� N�afterz+After time has not passed skipping job: %s.Zafter_not_passedrR rT TrS FrJ � r� r� r
rf r& r� r� r� r )rX r r� r r �
_handle_after� � �
z$Schedule.eval.<locals>._handle_afterc s� t sd�| d �| d< t�| d � dS | d }t|tj�s#t�|�}|� krAt�d| d � d| d< � | d < d
| d < d | d
< dS d
| d
< dS )z9
Handle schedule item with until
r rN r� N�untilz'Until time has passed skipping job: %s.Z until_passedrR rT TrS FrJ r )rX r r� r r �
_handle_until� r z$Schedule.eval.<locals>._handle_untilc S s | t j| jd� S )zH
Remove the microseconds from a datetime object
)� microseconds)r� r� � microsecond)�dtr r r �_chop_ms� s z Schedule.eval.<locals>._chop_msr= r" r# r% r$ )r% r" r# r$ )r� r� Z_enabledrS rR rT FrN z3Scheduled job "%s" should have a dict value, not %sr� rW r� Nr� r� r� Z run_on_startZ
_run_on_startT)r� r� r� r� )r� r� r� c S s g | ]}t |��qS r ��set��.0r� r r r �
<listcomp> s �z!Schedule.eval.<locals>.<listcomp>� c 3 s � | ]}|� kV qd S r r r ��
schedule_keysr r � <genexpr> s � z Schedule.eval.<locals>.<genexpr>z.Unable to use "%s" options together. Ignoring.z", "c 3 s � | ] }t |�� kV qd S r r )r �xr r r r" , s � z.Unable to use "%s" with "%s" options. Ignoringr� rJ c s g | ]}|� v rd �qS �Tr )r rH )rX r r r 8 s r� r� r� r� r� z=schedule.handle_func: Adding splay of %s seconds to next run.r� r� r r
r� r r zJob: %s is disabled�disabledrR rT rS � z (runtime missed by z seconds)rK z_schedule: Job %s was scheduled with jid_include, adding to cache (jid_include defaults to True)rQ z6schedule: Job %s was scheduled with a max number of %szMschedule: maxrunning parameter was not specified for job %s, defaulting to 1.rP z'Running scheduled job: %s%s with jid %s)r� Z _last_run)'r
Ztracer r& r� r� rI r' r? r" r# r% r$ r� rf �typer r~ rY r rz � itertools� combinations�anyr^ �chainr� r� r r r) �absr rZ r r
r� r� r� ) r rY Zjidsr2 r� r� r� r� r r r r r r r r r< Z_hiddenrG rH Zjob_namerW Z
time_elementsZscheduling_elementsZinvalid_sched_combosZinvalid_time_combosZ all_itemsr� r$ Zmiss_msgr� r )rX rY rJ r! r r �eval� s2
"m $#O G
�
�
�
���
�
��
�
�
�
�
��
�
�
��
�
��
��
� �� ���
� � ���z
Schedule.evalc
C s� |� dd�}|rt�d|d � d S | j� dd�}| j� dd�}|du r.| �d|||� d S |rHtjj�� rH| j }i | _ | j
}i | _
| j} i | _zt|rQtjj j }
nt
j}
d�|d |�} |r�tjj �tjtj�� |
| j||||f| d �} | �� | j�| � W d � n1 s�w Y n|
| j||||f| d �} | �� | j�| � W |r�tjj�� r�|| _ || _
| | _d S d S d S |r�tjj�� r�|| _ || _
| | _w )
N�dry_runFz1Job %s has 'dry_run' set to True. Not running it.rN �multiprocessingT� run_schedule_jobs_in_backgroundzSchedule(name={}, jid={}))�targetr� rN )r) r
r r r� r r
r� r� r r r5 ZSignalHandlingProcess� threading�Threadr� Zdefault_signals�signal�SIGINT�SIGTERMr� r �add)
r rW rX r� Z job_dry_runr� r0 r r r
Z
thread_clsrN �procr r r r� sd �
� ��
� �
�zSchedule._run_jobc C s | j �� d S r )r r r7 r r r �cleanup_subprocessesY s z Schedule.cleanup_subprocesses)NNNNFFNN)NNNNFNN)TTF)TTr$ )r� T)Fr )"�__name__�
__module__� __qualname__�__doc__r r r r r8 r/ rI rZ rh rw rx r4 r r� r� r� r� r� r� r� ry r� r� r� r� r� r� r- r� r9 r r r r r F s�
�-
�
�7
� 3
'
.
"
$
M <r c
C sV t �tj�| d ��D ]�}t j�tj�| d �|�}tjj� |d��~}d}ztj
� |�}W n0 t y] tjj
�� r>|�� zt �|� W Y W d � q ty\ Y Y W d � q w w t�d|� |dur�d|v r�tjj�|d �r~t�d|d � ntjj
�� r�|�� zt �|� W n ty� Y nw W d � n1 s�w Y q dS )z�
Loop through jid files in the minion proc directory (default /var/cache/salt/minion/proc)
and remove any that refer to processes that no longer exist
r� �rbNz>schedule.clean_proc_dir: checking job %s for process existencerO z@schedule.clean_proc_dir: Cleaning proc dir, pid %s still exists.)r[ �listdirr rU r� r\ r^ r
ra rb r� r� r+ r� Z
is_windows�closer� re r
r r5 rV )r Z basefilenameZfn_rg rG r r r r3 ] sL
� � �
�� �� ���r3 )1r= rA r� r� r( r- r[ r� r4 r0 r2 r� r� Z salt.configr Zsalt.defaults.exitcodesZsalt.exceptionsZ salt.loaderZ salt.minionZ salt.payloadZ
salt.syspathsZsalt.utils.argsZsalt.utils.errorZsalt.utils.eventZsalt.utils.filesZsalt.utils.jidZsalt.utils.masterZsalt.utils.minionZsalt.utils.platformZsalt.utils.processZsalt.utils.stringutilsZsalt.utils.userZsalt.utils.yamlr Zsalt.utils.odictr Zdateutil.parser�parserr� r� r
� ImportErrorr r � getLoggerr: r
r r3 r r r r �<module> s� � �
%