File: //opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/__pycache__/cloud.cpython-310.pyc
o
�N�gR� � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
Z
ddlZddlZddlZddlZddlmZ ddlZddlZddlZddlZddlZddlZddlZddl Zddl Zddl Zddl Zddl Zddl!Zddl"Zddl#Zddl$Zddl%Zddl&Zddl'm(Z(m)Z)m*Z*m+Z+m,Z,m-Z- ddl.m/Z/ ddl0m1Z1 zddl2ZdZ3W n e4y� dZ3Y nw z6dd l5m6Z7 dd
l8m9Z9 dd l:m;Z< dd l=m>Z>m?Z? dd
l@mAZA e�Bd��CejD� e�Bd��CejD� dZEW n e4�y dZEY nw dZFz%ddlGZGddlHZHddlImJZJ eG�Kd�ZLejMjN�OeLjPdeF��s+dZQndZQW n e4�y: dZQY nw zddlRZRW n e4�yS ejMjS�T� �sQ� Y nw zddlUZUdZVW n e4�yh dZVY nw dZWddddd�ZXe�YdejZ�Z[e�YdejZ�Z\d Z]d Z^e�Be_�Z`d�d d �Zad!d"� Zbd#d$� Zcd�d%d&�Zdd�d(d)�Zed*d+� Zfd,d-� Zgd.d/� Zhd0d1� Zid2d3� Zjd�d5d6�Zkd�d7d8�Zld�d9d:�Zmd�d<d=�Znd>d;de]e^fd?d@�ZoG dAdB� dB�Z6d�dDdE�Zpd�dFdG�Zqd�dHdI�Zrd�dJdK�Zs d�dLdM�Zt Pd�dQdR�Zu Pd�dSdT�Zv > U V U P W d�dXdY�ZwdZd[� Zx C ; N U \ ] d�d^d_�Zy > ; V U U ` d�dadb�Zz > ; V U cd�ddde�Z{dfdg� Z|d�didj�Z}d�dkdl�Z~d�dmdn�Zd�dodp�Z�d�dqdr�Z�dsdt� Z�dudv� Z�d�dwdx�Z�d�dzd{�Z�d|d}� Z�d~d� Z�d�d�� Z�d�d�d��Z� y � P Od�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�� Z�d�d�d��Z�d�d�d��Z�d�d�d��Z� d�d�d��Z� d�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�d�d�� Z�e��d�e�� d�d�� Z�d�d�� Z�d�d�d��Z�d�d�� Z� d�d�d��Z�d�d�� Z�d�d�� Z�d�d�� Z�dS )�z"
Utility functions for salt.cloud
� N)�Template)�SaltCloudConfigError�SaltCloudException�SaltCloudExecutionFailure�SaltCloudExecutionTimeout�SaltCloudPasswordError�SaltCloudSystemExit)�NonBlockingPopen)� is_writeableTF)�Client)�
SCMRException)�Service)� CannotDelete�SMBResponseException)� TreeConnectZ smbprotocolZpypsexecz0.3.0)�WinRMTransportErrorZpywinrmz>=zutf-8ZrunningZ rebootingZ
terminated�pending)r � � � z"(?:.*)[Pp]assword(?: for .*)?:\ *$z((?:.*sudo)(?:.*)[Pp]assword(?: for .*)?:�< r � c C s� t �d| � z1tjj�| d�� }ttjj�|� � ��}t
|j |||d��W d � W S 1 s0w Y W dS t ya tjj�| d��}t
|� � �W d � Y S 1 sYw Y Y dS w )z$
Return the rendered script
zRendering deploy script: %s�r)�optsZvm�minionN)
�log�info�salt�utils�files�fopenr � stringutils�
to_unicode�read�str�render�AttributeError)�path�vm_r r �fp_�template� r+ �D/opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/cloud.py�__render_script� s (�
*��r- c C s< i }| r | d |d< | d |d< | d |d< | d |d< |S )z�
Return a dictionary with gateway options. The result is used
to provide arguments to __ssh_gateway_arguments method.
� ssh_gateway�ssh_gateway_key�ssh_gateway_user�ssh_gateway_commandr+ )�gatewayZextended_kwargsr+ r+ r, �__ssh_gateway_config_dict� s r3 c C s� d}| � dd�}d}d|v r|�d�\}}| � dd�}|rh| � d|�}d| v r.d �| d �nd}| � d
d �}d �d
dd�| � dt��d�| � dt��ddt|�|� d|� �dt|�t|�f �}t�d||||� |S )a
Return ProxyCommand configuration string for ssh/scp command.
All gateway options should not include quotes (' or "). To support
future user configuration, please make sure to update the dictionary
from __ssh_gateway_config_dict and get_ssh_gateway_config (ec2.py)
r r. � �:r1 z nc -q0 %h %p�ssh_gateway_portr/ �-i {}r0 �root� Zssh�-oStrictHostKeyChecking=no�-oServerAliveInterval={}�server_alive_interval�-oServerAliveCountMax={}�server_alive_count_max� -oUserKnownHostsFile=/dev/null�-oControlPath=none�@z-pz Using SSH gateway %s@%s:%s %s) �get�split�format�join�SERVER_ALIVE_INTERVAL�SERVER_ALIVE_COUNT_MAXr$ r r )�kwargsZextended_argumentsr. r6 r1 r/ r0 r+ r+ r, �__ssh_gateway_arguments� sN ��
�
� ���rI c C s� |rt |�}tj�| �rt| |||�S tj�| � d��r&t| � d�|||�S |d D ]:}tj�tj�|| ��rEttj�|| �|||� S tj�tj�|| � d���rdttj�|| � d��|||� S q*dS )z;
Return the script as a string for the specific os
�.sh�deploy_scripts_search_pathr )�salt_config_to_yaml�osr' �isabsr- �isfilerE )Zos_r( r r Z search_pathr+ r+ r, � os_script� s ��rP � c C s� | dk rd} t �� }tj�|d| � tj�|d�}tj�|d�}tjj �
|��}tjj � |�
� �}W d � n1 s;w Y tjj �
|��}tjj � |�
� �}W d � n1 s[w Y t�|� ||fS )zG
Generate Salt minion keys and return them as PEM file strings
rQ r z
minion.pemz
minion.pubN)�tempfileZmkdtempr �crypt�gen_keysrM r' rE r r r r! r" r# �shutil�rmtree)�keysizeZtdirZ priv_pathZpub_pathr) Zpriv�pubr+ r+ r, rT � s � �
rT c C s� dD ]}t j�| |�}t j�|�st �|� qt j�| d|�}tjj�|d��}|� tjj
� |�� W d � n1 s<w Y t j�| d|�}t j� |�r|tjj�|�� }|�
� |krjt �|� W d � dS W d � dS 1 suw Y dS dS )z�
If the master config was available then we will have a pki_dir key in
the opts directory, this method places the pub key in the accepted
keys dir and removes it from the unaccepted keys dir if that is the case.
)�minions� minions_preZminions_rejectedrY zw+NrZ )rM r' rE �exists�makedirsr r r r �writer! �to_strrO r# �remove)�pki_dirrX �id_Zkey_dir�key_path�keyr) �oldkeyr+ r+ r, �
accept_key s$
� � �"��re c C s: t j�| d|�}t j�|�rt �|� t�d|� dS dS )zH
This method removes a specified key from the accepted keys dir
rY z Deleted '%s'N)rM r' rE rO r_ r �debug)r` ra rc r+ r+ r, �
remove_key! s
�rg c C s@ t j�| d|�}t j�| d|�}t j�|�r t �||� dS dS )z>
Rename a key, when an instance has also been renamed
rY N)rM r' rE rO �rename)r` ra Znew_idrd Znewkeyr+ r+ r, �
rename_key+ s
�ri c C s� dddd�}|d |d< t j�d|| �}|dur ||d< |�t jjd || i d
d �� t j�d || �}d
|vr>|d
ur>td��|�di ��t jjd|| i d
d �� |S )zI
Return a minion's configuration for the provided options and VM
r r �sha256)�master� log_level� hash_type�name�id�
master_fingerNr T��default�
search_global� make_masterrk z?A master setting was not defined in the minion's configuration.�grains)r �config�get_cloud_config_value�updater �
setdefault)r r( r rp rt r+ r+ r, �
minion_config5 s0 �
��
�
��rz c C s> t �tjj�}|jdddd� |�tjjd|| i dd�� |S )zI
Return a master's configuration for the provided options and VM
r rj )rl Zlog_level_logfilerm rk Trq )�copy�deepcopyr rv ZDEFAULT_MASTER_OPTSrx rw )r r( rk r+ r+ r, �
master_configc s
��r} �
c C s t jjj| |dd�S )zR
Return a salt configuration dictionary, master or minion, as a yaml dump
F)�
line_breakZdefault_flow_style)r r ZyamlZ safe_dump)Z
configurationr r+ r+ r, rL x s �rL c C sV |du rt }tjjd| |dd�}tjjd| |dd�}|du r(|du r(dddiiS | �d �d
kr2d }nd}tjjd | |dtjjd
| |ddd�d�}|durZtj�|�sZtd|� d���d}|�dd�rudtj v rut
� t�
tj d �j �rud }|du r�tjjd| |dd�du r�tjjd| |dd�du r�|du r�t
d��i }t|| �}ttjjd| |dd�| ||�} tjjd| |dd�}
d|vr�| �dd�|d< d | v�rd | v�rt�d | d � ttj�d | |��\| d < | d < | �d �} d!| v r�d"�| | d! g�} t|d# | d | � d| v�rtj�d$| |�| d< tj�d%| |�} i d&|�d'| �d(tjjd)| |d*d��d+| �d+| ��d,|
�d$| �d|�d | d �d-|�d.tjjd.| |d/d��d0| �d1|d1 �d2|d2 �d3|d3 �d4|d4 �d5| d �d6| d �i d7tjjd7| |dd��d8|d8 �d9tjjd9| ||
dkd��d:tjjd:| |dd��d;tjjd;| |d d��dtjjd| |dd<��d |�d=tj�d=| |��d>tj�d>| |��d?|�d@tjjd@| |dd��dA| �dAd��dBtjjdB| |d d��dCtjjdC| |dDd��dEtjjdE| |dd��dFtjjdG| |dHd��dItjjdI| |g d���dJ| d | dK | dL dM�i�}
|
�� }dN| v �r2|
�dN| dN i� tj�dO| |�d u �rad |
dO< | dP |
dP< | dQ |
dQ< t|| �}||
dR< |�dSd��rad |
dT< tjjdU| |d d�|
dU< |�rtdV|
dG< tj�dW| |�}|�r�tjjdX| |dYd�|
d(< ||
dW< t|| �}|dZ |
dZ< tjjd[| |d\d�|
d,< tjjd| |d]d�}|�r�||
d< tjjd^| |dd�|
d^< tjjd_| |d`d�|
d_< tjjda| |d d�|
da< tjjdb| |d d�|
db< |�r�dc|
dd< t�|
�}|d&= |d5= |d6= |d:= d|v �r|d= ||de< tdfdgdh�| d �ditjj � |�i|�d3tj�t d3 dZ��|�djdk�dl� |�rR|du �rRt dsi |��}|du�rLt� dm| d � d|dn< |S |�r]t dsi |
��}nt!dsi |
��}|�r{t dsi |��}|du�r{t� dm| d � |du�r�d |dn< |d u�r�|�|� t� do| d � |S t�"dp| d � ddqdr�| d �iiS )tz�
This is the primary entry point for logging into any system (POSIX or
Windows) to install Salt. It will make the decision on its own as to which
deploy function to call.
N�deployF�rr �
inline_script�Errorz No Deployz''deploy' is not enabled. Not deploying.�driverZsaltifyT� key_filenameZ ssh_keyfile�rs rr zThe defined ssh_keyfile '�' does not existZ ssh_agentZ
SSH_AUTH_SOCK�passwordZ win_passwordz�Cannot deploy Salt in a VM if the 'key_filename' setting is not set and there is no password set for the VM. Check the provider docs for 'change_password' option if it is supported by your provider.rM �bootstrap-salt� ssh_usernamer8 �file_transport�sftpZpub_keyZpriv_keyzGenerating keys for '%s'rn rW Z
append_domain�.r` �scriptZssh_hostr �host�portZssh_portr4 � salt_host�username�
has_ssh_agent�tmp_dir�/tmp/.saltcloudr( � start_action�parallel�sock_dir� conf_file�
minion_pem�
minion_pub�master_sign_pub_file�keep_tmp�sudo�
sudo_password�tty)rs � script_args�
script_env� minion_conf�force_minion_config�preseed_minion_keys�display_ssh_output�known_hosts_file� /dev/null�file_map�maxtriesZwait_for_passwd_maxtries� �preflight_cmds� cloud_grains�provider�profile)r� r� r� r2 rt �
master_pub�
master_pem� master_confZ
syndic_master� make_syndic� make_minionr �
win_installerZsmb_port� rk Z win_username�
Administratorr � use_winrm�
winrm_port�b �
winrm_use_ssl�winrm_verify_sslr � port_timeout�
deploy_kwargs�eventzexecuting deploy scriptzsalt/cloud/{}/deployingrH � transport�zeromq��argsr� r� z#Inline script(s) ha(s|ve) run on %s�deployedzSalt installed on %sz Failed to start Salt on host %sz Not Deployedz Failed to start Salt on host {}r+ )#�__opts__r rv rw rB rM r' rO r �environ�stat�S_ISSOCK�st_moder rz rP r rf rT rE re r{ rx r} r| �
fire_eventrD r �dataZsimple_types_filter�run_inline_scriptr �deploy_windows�
deploy_script�error)r( r Z
deploy_configZinline_script_configZsaltify_driverr� r� �retr� Zdeploy_script_coder� Zkey_idr� r� Zinline_script_kwargsr� r� r Zwin_passZ event_kwargsZinline_script_deployedr� r+ r+ r, � bootstrap� s� ��
��
�
�
����
���
��� ����� �
��
���������� ���� � ��"�#�$�%�&�� )�*��-��0��3��6��9��@
��
�
��
�
�
�
�
�
�r� c C sr |du rdg}t j�d| |�}t|t�s|g}dd� |D �}|dd� }|D ] }||vr1|�|� q&|�|� |S )zT
Return the ssh_usernames. Defaults to a built-in list of users for trying.
Nr8 r� c S s g | ]}|r|�qS r+ r+ )�.0�xr+ r+ r, �
<listcomp>� s z!ssh_usernames.<locals>.<listcomp>)r rv rw �
isinstance�list�append�extend)r( r Z
default_usersZ usernames�initialrn r+ r+ r, �
ssh_usernames� s
�
r� � c
K s� t � � }t�d| � d} |d7 }z| d
i |��}t|t�s!|W S W n$ tyF } zt�d|� t �d� t�d| |� W Y d}~nd}~ww t � � | |krWt�d|� d S q
) z6
Wait until a function finishes, or times out
zAttempting function %sr Tr z$Caught exception in wait_for_fun: %sz!Retrying function %s on (try %s)NzFunction timed out: %sFr+ )�timer rf r� �bool� Exception�sleepr� )�fun�timeoutrH �start�trycount�response�excr+ r+ r, � wait_for_fun� s(
�
�� �r� r4 c C s. t � � }| }|}|r1|d } d}
d| v r| �d�\} }
d|v r#|d }
| }|
}t�d| || |
� nt�d| |� d} | d 7 } zt�tj| �rPt�tjtj�} nt�tjtj�} W n t yj t�tjtj�} Y nw z| �
d
� | � |t |�f� | �
tj� | �� W n@ t y� }
z3t�d |
� t �d � t � � | |kr�t�d |� W Y d
}
~
dS t�d|r�dnd||| � W Y d
}
~
nd
}
~
ww q;|s�dS t�d||� g }|�dd|� �d|� �ddg� d|v r�|�dddd d d �|d �g� d | � d |� �}d!�d �|�|d" | |
t�d#��}d!�d �|�|d" | |
t�|��}t�d$|� d|�d%d
�d&�}d} d}d
} | d 7 } |�sat|fd'di|��}|dk�rPd}n
|d 8 }t�d(|� |�satd)��|�rut|fd'di|��}|dk�rudS t �d � t � � | |k�r�t�d |� dS t�d*| || |
| � �q7)+a
Wait until a connection to the specified port can be made on a specified
host. This is usually port 22 (for SSH), but in the case of Windows
installations, it might be port 445 (for psexec). It may also be an
alternate port for SSH, depending on the base image.
r. r4 r5 r6 zEAttempting connection to host %s on port %s via gateway %s on port %sz+Attempting connection to host %s on port %sr Tr � z%Caught exception in wait_for_port: %sz Port connection timed out: %sNFz0Retrying connection to %s %s on port %s (try %s)r2 r� z#Gateway %s on port %s is reachable.r: z-oServerAliveInterval=z-oServerAliveCountMax=r? r@ r/ �-oPasswordAuthentication=no�$-oChallengeResponseAuthentication=no�-oPubkeyAuthentication=yes�-oIdentitiesOnly=yes�!-oKbdInteractiveAuthentication=nor7 znc -z -w5 -q0 r9 zssh {} {}@{} -p {} {}r0 �date�SSH command: '%s'Zssh_gateway_password)r� r� �
allow_failurezAGateway usage seems to be broken, password error ? Tries left: %sz-SSH gateway is reachable but we can not loginzMRetrying connection to host %s on port %s via gateway %s on port %s. (try %s))r� rC r rf �socket� inet_pton�AF_INET6� SOCK_STREAM�AF_INET�OSError�
settimeout�connect�int�shutdown� SHUT_RDWR�closer� r� r� rD rE �shlex�quoterB �
_exec_ssh_cmdr )r� r� r� r2 r< r> r� Z
test_ssh_hostZ
test_ssh_portr. r6 r� �sockr� �ssh_args�commandZpcmd�cmdrH Zusable_gatewayZgateway_retriesZpstatus�statusr+ r+ r, �
wait_for_port� s �� �
���� �� ����
�
��
��r c @ s^ e Zd ZdZ ddd�Zdd� Zd d
� Zd d � Zd
d� Zdd� Z dd� Z
ddd�Z dS )r at
Wrap pypsexec.client.Client to fix some stability issues:
- Set the service name from a keyword arg, this allows multiple service
instances to be created in a single process.
- Keep trying service and file deletes since they may not succeed on the
first try. Raises an exception if they do not succeed after a timeout
period.
Nr� Tc C s> || _ | j � d�| _t|||||�| _t| j | jj�| j_d S )Nz.exe)� service_name� _exe_file� PsExecClient�_client� ScmrService�session�_service)�selfZserverr� r� r� �encryptr r+ r+ r, �__init__u s zClient.__init__c C s | � � | �� | S �N)r� �create_service�r r+ r+ r, � __enter__� s zClient.__enter__c C s | � � | �� d S r )�remove_service�
disconnect)r Ztb_typeZtb_value�tbr+ r+ r, �__exit__� s zClient.__exit__c C �
| j �� S r )r r� r r+ r+ r, r� � �
zClient.connectc
C sJ z| j �� W n ty } z t�d|� W Y d }~nd }~ww | j �� S )Nz Exception cleaning up PAexec: %r)r Zcleanupr r rf r )r r� r+ r+ r, r � s ��
zClient.disconnectc C r r )r r r r+ r+ r, r � r zClient.create_servicec O s | j j|i |��S r )r �run_executable)r r� rH r+ r+ r, r � s zClient.run_executable�
r c
C sH t �d� t�� } z| jj�� W n) ty; } z t �dt|�� t�� | |kr,|�t�|� W Y d}~q d}~ww t | jj
d| jj j � d��}t �
d|j� |�� t�� } zt �
d� | j�|| j� W n+ ty� } z t �d | jt|�� t�� | |kr�|�t�|� W Y d}~qZd}~ww t �
d
|j� |�� dS ) z�
Removes the PAExec service and executable that was created as part of
the create_service function. This does not remove any older executables
or services from previous runs, use cleanup() instead for that purpose.
z1Deleting PAExec service at the end of the processTz/Exception encountered while deleting service %sNz\\z\ADMIN$zConnecting to SMB Tree %sz7Creating open to PAExec file with delete on close flagsz Exception deleting file %s %sz Disconnecting from SMB Tree %s)r rf r� r r �deleter �reprr� r r
�
connectionZ server_namer Z
share_namer� Z _delete_filer r r )r Z wait_timeoutZ
sleep_waitZ
wait_startr� Zsmb_treer+ r+ r, r � sH
���
�� zClient.remove_service)NNr� TN)r r ) �__name__�
__module__� __qualname__�__doc__r r r r� r r r r r+ r+ r+ r, r j s
� r r� c C s^ d|� d|� d|� �}d|� d|� �}d|� d| � d|� �} d|� d| � d|� �}t | |d�S )z:
Run a command remotely via the winexe executable
z-U '�%�' //z%XXX-REDACTED-XXX' //zwinexe r9 ��logging_command)�win_cmd) r r� r� r� r� r� ZcredsZ
logging_creds� logging_cmdr+ r+ r, �run_winexe_command� s
r( c C s^ dt �� � �}t||||d|d��}|�| |�\}} }
W d � n1 s%w Y || |
fS )z:
Run a command remotely using the psexec protocol
zPS-Exec-F)r� r
r N)�uuid�uuid4r r ) r r� r� r� r� r� r �client�stdout�stderr�ret_coder+ r+ r, �run_psexec_command� s � �
r/ c
C s� t � � }t�d| |� d} |d7 }z tdd| |||�}|dkr(t�d� W dS t�d|� W n tyG } z t�d |� W Y d
}~nd
}~ww t � � | |krRd S t �d� q) z:
Wait until winexe connection can be established.
z2Attempting winexe connection to host %s on port %sr Tr Zsczquery winexesvczwinexe connected...�Return code was %sz*Caught exception in wait_for_winexesvc: %sNF)r� r rf r( r� r� ) r� r� r� r� r� r� � try_countr. r� r+ r+ r, �wait_for_winexe� s* �
��
�r2 c
C s� t � � }d} |d7 }d}ztdd| |||d�\}} }W n ty3 }
z t�d� W Y d}
~
nd}
~
ww |dkr?t�d � dS t � � | |krId
S t�d | ||� t �d� q) z:
Wait until psexec connection can be established.
r Tr �cmd.exe� /c hostname�r� zUnable to execute commandNzpsexec connected...Fz9Retrying psexec connection to host %s on port %s (try %s))r� r/ r� r � exceptionrf r� ) r� r� r� r� r� r� r1 r. r, r- r� r+ r+ r, �wait_for_psexecsvc� s4 ���
�
�r7 c
C s> t | ||d� t�� }t�d| |� d}|sd}d} | d7 } zI| ||f|d�}
|s3t�d � d
|
d < tjdi |
��} t| jd �rG| j�d
� t� d| j
� | � d�} | j dkr`t�d� | W S t�d| j � W n t
y� }
z t�d|
� W Y d}
~
nd}
~
ww t�� | |kr�t�d|� dS t�d| || � t�d� q)z9
Wait until WinRM connection can be established.
�r� r� r� z1Attempting WinRM connection to host %s on port %s�sslZntlmr Tr )�targetZauthr� z"SSL validation for WinRM disabled.�ignoreZserver_cert_validation� set_timeoutr� zWinRM endpoint url: %szsc query winrmzWinRM session connected...r0 z&Caught exception in wait_for_winrm: %sNz WinRM connection timed out: %sz8Retrying WinRM connection to host %s on port %s (try %s)r+ )r r� r rf �winrmZSession�hasattr�protocolr< �trace�url�run_cmd� status_coder r� r� )r� r� r� r� r� �use_ssl�verifyr� r� r� Z winrm_kwargs�sr r� r+ r+ r, �wait_for_winrm sR �
�� �
�rG r� r r c C sF d|� d|� d| � d�}d� || �}t|�D ]}t||d�}q|dkS )�4
Check if the windows credentials are valid
z winexe -U 'r" r# z "hostname"z/winexe -U '{}%XXX-REDACTED-XXX' //{} "hostname"r$ r )rD �ranger& ) r� r� r� �retries� retry_delayr r' �ir. r+ r+ r, � validate_windows_cred_winexeK s � rM c
C s� t |�D ]9}d}ztdd| ||dd�\}}}W n ty. } z t�d� W Y d} ~ nd} ~ ww |dkr8 |dkS t�|� q|dkS ) rH r r3 r4 r� r5 z Exception while executing psexecNr )rI r/ r� r r6 r� r� )
r� r� r� rJ rK rL r. r, r- r� r+ r+ r, �validate_windows_credZ s ��� �rN r� r8 r� c
C s> d} | |k r�d}
zr| ||||||
|| d� }|� t| �� |r6tj�|�s+td�|���||d< t�d|� n |rA||d< t�d� | d 7 } t�d
|| |� t dddd �|��}|dkrqd
}
| |k rht
� |� W qt� d|� W dS |
du rxW d
S W dS t
y� � ty� | |kr�Y dS t
� |� Y nw | |k sdS dS )zK
Wait until ssh connection can be accessed via password or ssh key
r F) �hostnamer� r� �password_retriesr� r� r� � ssh_timeout� hard_timeoutz,The defined key_filename '{}' does not existr� � Using %s as the key_filenamer� z Using password authenticationr z/Attempting to authenticate as %s (try %s of %s)r� )r� r� Tz%Authentication failed: status code %sN)r� )rx r3 rM r' rO r rD r rf �root_cmdr� r� r� r r� )r� r� rQ r� r� r� r� Ztrysleepr� r2 r� rR r� Z connectfailrH r r+ r+ r, �wait_for_passwdn sj � ��
�
��rU c C s t | t�r
d�| �S | S )zy
If the master is a list, we need to convert it to a comma delimited string
Otherwise, we just return master
�,)r� r� rE )rk r+ r+ r, �_format_master_param� s
rW �
C:\salttmpr� c - K sp t |t�si }|rtst�dt� dS t�t�� �} t� d| | � t�
dt|� t | ||d d�} | s5dS d} d} trQ|rQt | ||||d ||d�} | durPd } n t
| ||||d d
�} | �r6| �r6t� d || � t� d | ||� tjj�| |||�} | du r�t�d
� dS tjjjd| d� d}!tjjj|!� d�| d� d}!|
r�tjjj|
|!� d�| d� | r�tjjj| |!� d�| d� |r�t� d|� ztjjj||!� d�| d� W n ty� }" z t� d|� W Y d}"~"nd}"~"ww |�d�}#d�|#dd� �}$|#d }%tjjj|d|%� �d| d� d |%� �}&d d t|�� �d |� �g}'|�r)t| |&|'� nt|&d �|'�| ||�\}(})}*|*d!k�rCtd"|*� ���| �r�t | t��sPtd#��| � d$i �}+|+�rjtjjjt |+d%d&�|!� d'�| d� | � d(d)�| � d*d�| � d+d �d,�},|�r�d-| v�r�||,d-< |�r�d.| v�r�||,d.< t| fi |,��} tjjjt | d%d&�|!� d/�| d� |
�s�|�r�t| d0g d1�� ntjjj d|%� �d| d� tjjj dd| d� |�r�t| d2d3d4g� t| d2d5d4g� n)td6d7| ||�\}(})}*|*d!k�r�dS t� d8� td6d9| ||�\}(})}*|*d!k�rdS t d:|� d;| � �d<|� d=�d>|i|�!d?t"j#�t$d? d-��|�!d@dA�dB� d S dS )CzJ
Copy the install files to a remote Windows box, and execute them
zbWinRM requested but module winrm could not be imported. Ensure you are using version %s or higher.Fz Deploying %s at %s (Windows)z HAS_WINRM: %s, use_winrm: %sr r8 N)r� r� r� r� r� rD rE T)r� r� r� r� r� z SMB port %s on %s is available�Logging into %s:%s as %sz6Please install smbprotocol to enable SMB functionalityZsalttemp)�connz ProgramData/Salt Project/Saltz/conf/pki/minionz ProgramData\Salt Project\Saltz\conf\pki\minion\minion.pubz\conf\pki\minion\minion.pemz.Copying master_sign.pub file from %s to minionz \conf\pki\minion\master_sign.pubz3Exception copying master_sign.pub file %s to minion�/���z salttemp\zC$z c:\salttemp\�/Sz/master=z
/minion-name=r9 r zFail installer zp`salt.utils.cloud.deploy_windows` now only accepts dictionaries for its `minion_conf` parameter. Loading YAML...ru z
)r z \conf\grains�ipc_modeZtcpr` �multiprocessing)r^ r` r_ rk ro z \conf\minion�rmdir)z/Qr] z C:\salttemp\�net�stopz salt-minionr� r3 z/c net stop salt-minionz Run psexec: sc start salt-minionz/c net start salt-minionr� � has been deployed at � salt/cloud/z/deploy_windowsrn r� r� r� r� )%r� �dict� HAS_WINRMr r� �
WINRM_MIN_VERr� �mktime� localtimerf r@ r rG r7 r r �smbZget_connZmkdirsZput_strZput_filer� rC rE rW � winrm_cmdr/ �DeprecationWarning�poprL Z delete_fileZdelete_directoryr� rB rM r' r� )-r� r� r� r� r� rn r� r� r� r� r� r� r� r� r� r� r� r� r� rk r� r r� r� r� r� r� rH � starttimeZport_availableZservice_availableZ
winrm_sessionZsmb_conn�root_dir�e�compsZ
local_pathZ installerr r� r, r- r. �
minion_grainsZwindows_minion_confr+ r+ r, r� � s4
!�� ��
���
����
�
�
�
�
�
�
� �
�
�
� r� r� c' H
K s< t |!t�si }!| p
i } |%pi }%d�|"�d�t�� �}"tjjd| |!t j
� |"d�d�}(|dur;t j
� |�s;t
d|� d���d})d |'v rE|'d })t�� }*t�d
| t�d |*�� |'�d d
�}+|!�dd�},t| ||)d��r�t�d|| � t| |||||||)|+||,d� �r�t�d| ||� | |||||| |!�dd�d�}-|-�t|)�� |r�t�d|� ||-d< n|r�|'�dd�du r�||-d< td|"� d�| | fd d i|-��r�td |"� d �| | fi |-��}.|.r�td |"� d!���| �r |"�d��d��d�}/|/�r t |/�d"ks�|/d# d$k�r td%|� d&|"� d'�| | fi |-��}.|.�r td(|� d)|"� ���t |#t��s$i }#g }0g }1g }2|#D ]}}3|3}4|#|3 }5t j
� |3��sKt� d*|4|5� |2� |4|5i� �q,t j
� |4��rdt j
�!|4�}6t j
� t j
�"|5�|6�}7nt j
�"|5�}7|7|0v�r�td+|7� d�| | fi |-�� |-d, d-k�r�td.�|-d, |7�| | fi |-�� |0� |7� t#|!|5|-|4d/� |1� |4|5i� �q,|�r�t#|!|"� d0�||-� td1|"� d2�| | fi |-��}.|.�r�td3|"� d0���|�r�t#|!|"� d4�||-� |$�r�t#|!|"� d5�|-|$d/� |�r)t |t��s�t$d6��|�%d7i �}8|8�r
t#|!|"� d8�t&|8�|-� |%�r |!�d9d ��r d:|%i|d7< t#|!|"� d;�t&|�|-� |�rOt#|!|"� d<�||-� td1|"� d=�| | fi |-��}.|.�rOtd>|"� d<���|
�r\t#|!|"� d?�|
|-� |�rut |t��sit$d@��t#|!|"� dA�t&|�|-� |"� dB�}9|du�r�tdC|9� d�| | fi |-��}.|.�r�tdD|9� ���tdE|9� d�| | fi |-��}.|.�r�td3|9� ���|-d, d-k�r�td.�|-d, |9�| | fi |-�� |�'� D ]\}:};t j
� |9|:�}<t#|!|<|;|-� �q�|-d, d-k�r�tdF|9� d�| | fi |-�� |.�r�tdG�|9���|'�dHg �}=|=D ]}>t|>| | fi |-��}?|?�r tdI|>� d����q|�rDt#|!|"� dJ�||-� tdK|"� dL�| | fi |-��}.|.�rDtd3|"� dJ���t�(t�� �t�(|*� }@||@ }Ad}Bd}C| �r}| �s}t)�*� }Bt)j+t,t|||A|BdM�dN|� dO�dP�}Ct�dQ� |C�-� |�redR|v �r�|(dS|"� d�7 }(|&�r�|(dT7 }(|d u �r�|(dU7 }(| d u �r�|(dV7 }(|du �r�|(dW7 }(|d u �r�|(dX7 }(|du�r�|(dY|9� d�7 }(|�r�|(dZ|� �7 }(|�r t |t��s�td[�t.|����d\g}D|�'� D ]\}E}F|D� d]�|E|F�� �q�|D� |(� t#|!|"� d^�d_� |D�|-� td`|"� da�| | fi |-�� db�|"�}(t|(| | fi |-��d#k�r1tdc|(� dd���t�de|(� |�setdf|"� dg�| | fi |-�� t�dh|"� |�retdf|"� da�| | fi |-�� t�di|"� |�rot�dj|"� n�|�r�tdf|"� dk�| | fi |-�� t�dl|"� |�r�tdf|"� d2�| | fi |-�� t�dm|"� |�r�tdf|"� dn�| | fi |-�� t�do|"� tdf|"� dp�| | fi |-�� t�dq|"� |$�r�tdr|"� d5�| | fi |-�� t�ds|"� |
�r�tdf|"� dt�| | fi |-�� t�du|"� |�r
tdf|"� d=�| | fi |-�� t�dv|"� |�r$tdf|"� dw�| | fi |-�� t�dx|"� |du�r=tdy|9� d�| | fi |-�� t�dz|9� | �rj| �sj|B�� }G|C� � |G�rj| �rjt�/d{| � td|| � �| | fi |-�� t�/d}| � t0d~|� d| � �d�|� d��|| d��|!�d�t j
� t1d� d���|!�d�d��d�� |2�s�|1�r�|1|2d��S d S dS )�zL
Copy a deploy script to a remote server, execute it, and remove it
z{}-{}r[ �deploy_commandz deploy.shr� NzThe defined key_filename 'r� r2 �Deploying %s at %sz%Y-%m-%d %H:%M:%Sr� r� rR �r� r� r2 � SSH port %s on %s is available)
r� r� r� r� rQ r� r2 r� r� rR rY �use_sftpF)rO r� r� r� rQ r� r� r� rS r� r� r� z test -e '�'r� Tzsh -c "( mkdir -p -m 700 'z' )"z$Can't create temporary directory in z !r r �tmpzchown z "�"z Cant set z ownership on zWThe local file "%s" does not exist, and will not be copied to "%s" on the target systemz
mkdir -p 'r� r8 z
chown {} '{}')rH �
local_filez /minion.pemz chmod 600 'z /minion.pem'zCan't set perms on z /minion.pubz/master_sign.pubzo`salt.utils.cloud.deploy_script now only accepts dictionaries for it's `minion_conf` parameter. Loading YAML...ru z/grainsZenable_cloud_grainsz
salt-cloudz/minionz /master.pemz /master.pem'zCant set perms on z /master.pubzu`salt.utils.cloud.deploy_script now only accepts dictionaries for it's `master_conf` parameter. Loading from YAML ...z/masterz/preseed-minion-keyszmkdir 'z Cant create z chmod 700 'zchown -R root 'zCan't set ownership for {}r� z Pre-flight command failed: 'z
/deploy.shzsh -c "( chmod +x 'z/deploy.sh' )";exit $?)rn r� r� �queuezDeployScriptCheckAuth(�))r: rH rn z,Starting new process to wait for salt-minionr� z -c 'z -Fz -Sz -Mz -Nz -Kz -k 'r9 zHThe 'script_env' configuration setting NEEDS to be a dictionary not a {}z #!/bin/shz4setenv {0} '{1}' >/dev/null 2>&1 || export {0}='{1}'z/environ-deploy-wrapper.shr~ z
chmod +x 'z/environ-deploy-wrapper.sh'z '{}/environ-deploy-wrapper.sh'zExecuting the command 'z' failedzExecuted command '%s'zrm -f 'z /deploy.sh'zRemoved %s/deploy.shz$Removed %s/environ-deploy-wrapper.shz&Not removing deployment files from %s/z /minion.pub'zRemoved %s/minion.pubzRemoved %s/minion.pemz/grains'zRemoved %s/grainsz/minion'zRemoved %s/minionzrm -f zRemoved %s/master_sign.pubz /master.pub'zRemoved %s/master.pubzRemoved %s/master.pemz/master'zRemoved %s/masterzrm -rf 'z
Removed %sz Executing %s on the salt-minionz
salt-call z(Finished executing %s on the salt-minionr� rc rd z/deploy_script)rn r� r� rk r� r� r� )zFile Upload SuccesszFile Upload Failure)2r� re rD �rstripr) r* r rv rw rM r' rE rO r r� ri r rf �strftimerB r rU rx r3 rT r �lstriprC �lenr[ r� r� �isdir�basename�dirname�ssh_filerl rm rL �itemsrh r_ �QueueZProcess�
check_authr� �typer r� r� )Hr� r� r� r� r� r� r� rn r� r� r� r� rt r� r� r� r� r� r� r� r� r� rQ r� r� r� r� r� r� r� r� r� r( r r� r� r� r� r� rH rs r2 rn r� rR �
ssh_kwargsr� rq Z remote_dirsZfile_map_successZ
file_map_failZmap_itemr{ Z remote_fileZdir_nameZ
remote_dirrr Zpreseed_minion_keys_tempdir� minion_idZ
minion_keyZrpathr� r Zcmd_retZ time_used�
newtimeoutr| �processZenviron_script_contentsrc �valueZ queuereturnr+ r+ r, r� � s�
-�
� �
�
���
��
���� �
��
��
�� � � ��� ��
���
������
���� �
�� �
�
��
�
���
�
�� ��
��
�
�
�r� � /tmp/.saltcloud-inline_scriptc K s� d}d|v r
|d }t �t �� �}t�d| |� |�dd�}t| ||d�r�t�d|| � |t �t �� �| }t| ||| |||||d� r�t�d | ||� |t �t �� �| }| |||||
|�d
d �d �}|�t |�� |ryt�d
|� ||d< n| r�d|v r�|d d u r�| |d< t
d|� d�|
| fddi|��r�|r�t�d� |D ]!}t� d|� t
d|� d�|
| fddi|��}|r�t� d||� q�dS )z�
Run the inline script commands, one by one
:**kwargs: catch all other things we may get but don't actually need/use
Nr2 rt r� r� ru rv )r� r� r� r� rQ r� r2 r� rY rw F)rO r� r� r� r� r� r� rS r� r� r� z
test -e \"z\"r� Tz Found inline script to execute.z Executing inline command: %sz sh -c "( z )"z[%s] Output: %s) r� rh ri r rf rB r rU rx r3 rT r )r� rn r� r� r� r� r� rQ r� r� r� r� r� r� r r� rH r2 rn r� r� r� Zcmd_liner� r+ r+ r, r� � s� �
�
�
�����
����r� c C s� i }g }d}t �di �D ]}| |krq t d | d }t d | �dd�}q |du r,g }t|t�s5t|�}tt|| ��}|D ] }||v rK|| ||< q?|S )z�
Accept a tag, a dict and a list of default keys to return from the dict, and
check them against the cloud configuration for that tag
TZ
filter_events�keys� use_defaultsF)r� rB r� r� �set)�tagr� �defaultsr� r� r� Zktagrc r+ r+ r, � filter_event� s$
�r� r� c C s� t jjjd|dd��4}z|�||� W n ty0 t|t�r$||| < n| |i}|�||� Y nw t� d� W d � dS 1 sAw Y dS )z
Fire deploy action
rk F��listeng�������?N)
r r r� � get_eventr� �
ValueErrorr� re r� r� )rc �msgr� r� r� r� r� r+ r+ r, r� s
�
"�r� c
K s� |d u rd}|� dd�}z�z�d\}}tjjj| ddd|� dd�|� dd�d�}d}|jrp|�� \}}|rht�|�rhd |v rN|d rNt �|�rN|�
|d
� n|� d d �rd||k rd|d 7 }|�
|d � nt |��t �
d
� |js,|jdkr�|du r�td| � d|j� ���|jW W |jddd� S tjjjy� } zt�� }
t�|�| | |
�� W Y d } ~ nd } ~ ww W |jddd� d S |jddd� w )Nz@A wrong password has been issued while establishing ssh session.rP r �NNTr� )�shellZ
log_stdoutZ
log_stderrZ
stream_stdoutZ
stream_stderrr r� r� r� r � �?Fz Command 'z' failed. Exit code: )� terminate�kill)rB r r ZvtZTerminalZhas_unread_data�recv�SSH_PASSWORD_PROMP_RE�search�SSH_PASSWORD_PROMP_SUDO_REZsendliner r� r� Z
exitstatusr r� ZTerminalException� traceback�
format_excr r� rD ) r � error_msgr� rH rP r, r- �procZ
sent_password�errr@ r+ r+ r, r� sZ
� ��
��� ���r� c C s� d}�z$|durXz.t �� \}}t�||� W zt�|� W n: ty6 } z
|jtjkr,� W Y d}~n&d}~ww zt�|� W w tyW } z
|jtjkrM� W Y d}~w d}~ww t� d| |d � dd�
|� dt ��d�
|� dt
��d d
g}|dur�|}tj�|�r�|�d � d |v r�|�d
ddddd�
|d �g� d|v r�|�d�
|d �� |�t|�� zt�tj|d �r�d�
|d �}n|d }W n
ty� |d }Y nw |du r�t�d� d�
d�|�||| |�} t� d| � t| fddd �|��}
W |du�r&zt�|� W |
S t�y% } z|jtjk�r� W Y d}~|
S d}~ww |
S |du�rPzt�|� W w t�yO } z|jtjk�rE� W Y d}~w d}~ww w ) z4
Use scp or sftp to copy a file to a server
NzUploading %s to %srO r: r; r< r= r> r? r@ �-rr� r� r� r� r� r� r7 r� � -oPort={}�[{}]�nNo source file to upload. Please make sure that either file contents or the path to a local file are provided.z�scp {0} {1} {2[username]}@{4}:{3} || echo "put {1} {3}" | sftp {0} {2[username]}@{4} || rsync -avz -e "ssh {0}" {1} {2[username]}@{2[hostname]}:{3}r9 zSCP command: '%s'�$Failed to upload file '{0}': {1}
{2}r �r� rP )rR �mkstemprM r] r� r� �errno�EBADFr rf rD rB rF rG r' r� r� r� rI r� r� r� �warningrE r� r_ �ENOENT) � dest_path�contentsrH r{ �file_to_upload�tmpfdr� r �ipaddrr �retcoder+ r+ r, �scp_fileQ s� ���� ���
�
��
��� ���� ���
�
���
� ����r� c C s, | � dd�dkrt||||�S t||||�S )z]
Copies a file to the remote SSH target using either sftp or scp, as
configured.
r� r� )rB � sftp_filer� )r r� r� rH r{ r+ r+ r, r� � s r� c C s� g }|du ri }d}�z6|duroz=t �� \}}t|t�r&t�||�t�� nt�||� W zt�|� W n: t yM } z
|j
t
j krC� W Y d}~n&d}~ww zt�|� W w t yn } z
|j
t
j krd� W Y d}~w d}~ww |dur~|}tj �
|�r~dg}t�d| |�d�� dd�|�dt��d�|�d t��d
d g}d |v r�|�d
ddddd�|d �g� d|v r�|�d�|d �� |�t|�� zt�tj|d �r�d�|d �} n|d } W n
t y� |d } Y nw |du r�t�d� d�d�|�|| d�|�|| �}
t�d|
� t |
fddd �|��} W |du�r@zt� |� W | S t �y? } z|j
t
j k�r4� W Y d}~| S d}~ww | S |du�rjzt� |� W w t �yi } z|j
t
j k�r_� W Y d}~w d}~ww w ) z/
Use sftp to upload a file to a server
Nr� zUploading %s to %s (sftp)rO r: r; r< r= r> r? r@ r� r� r� r� r� r� z-oIdentityFile={}r� r� r� r� z3echo "put {0} {1} {2}" | sftp {3} {4[username]}@{5}r9 zSFTP command: '%s'r� r r� ) rR r� r� r$ rM r] �encodeZ__salt_system_encoding__r� r� r� r� r' r� r rf rB rD rF rG r� r� rI r� r� r� r� rE r� r_ r� ) r� r� rH r{ Zput_argsr� r� r� r r� r r� r+ r+ r, r� � s�
� ���� ���
�
�� ��� ��� ���
�
���
� ����r� c
K s� |� dd�}z1t| dtjtj|� dd�|d�}|du r$t�d|j| � nt�d|j|� |�� |�� |j W S t
yP } z
t� d|� W Y d}~dS d}~ww ) z>
Wrapper for commands to be run against Windows boxes
r% NTr� )r� r- r, Z stream_stdsr% z Executing command(PID %s): '%s'z Failed to execute command '%s'r ) rB r �
subprocess�PIPEr rf �pidZpoll_and_read_until_finish� communicate�
returncoder� r6 )r rH r% r� r� r+ r+ r, r& , s*
� ��r& c K s t �d||� | �||�}|jS )zK
Wrapper for commands to be run against Windows boxes using WinRM.
z Executing WinRM command: %s %s)r rf rB rC )r
r �flagsrH r r+ r+ r, rk J s rk c
K s� | }|� dd�}|r&|du rd| � �} | }n
d| � �}d| � �} t�d|� g }|r1|�ddg� |� dd �}d
} |d kr?d } |�d | � �d
|� �dg� d|v ra|�dddddd�|d �g� d|v rp|�d�|d �g� |�t|�g� d|v r�|�d�|d �g� d�d�|�|�}
|
| }|
t�| � }
|� d �} | dur�d | � d|� �}d | � d|
� �}
t�d |� t |
fd |i|��} | S ) z0
Wrapper for commands to be run as root
r� Nzsudo zsudo -S "XXX-REDACTED-XXX" zsudo -S z Using sudo to run command %sz-tr� r� �noZyesz-oStrictHostKeyChecking=z-oUserKnownHostsFile=r@ r� r� r� r� r� r� r7 rQ z-oConnectTimeout={}r� z-p {}z$ssh {0} {1[username]}@{1[hostname]} r9 rR ztimeout r� r� )
rB r rf r� rD rI rE r� r� r� )
r r� r� r� rH r% r� r r� Zhost_key_checkingr rR r� r+ r+ r, rT S s^
�� ��
rT �, c C s� t jjjd|dd��U}t�t�� �}|}t�d| � |dkrW|t�t�� �| }|j dd�}|du r4q|d d | � d
�krK|�
| � d}t�d | � |dks W d � dS W d � dS 1 sbw Y dS ) z�
This function is called from a multiprocess instance, to wait for a minion
to become available to receive salt commands
rk Tr� z1In check_auth, waiting for %s to become availabler )�fullNr� z salt/minion/z/startz&Minion %s is ready to receive commands) r r r� Z SaltEventr� rh ri r rf r� �put)rn r� r| r� r� rn r� r� r+ r+ r, r� � s"
��"�r� c C s( d}| � d�D ]
}|d t|� }q|S )z.
Converts an IP address to an integer
r r� � )rC r� )�ipr� �octetr+ r+ r, � ip_to_int� s r� c C s� d| v r
| � d�r dS dS t| �}d| k r dk r dS d| k r(dk r)dS d | k r4d
k r5dS d | k r@d k rCdS dS dS )
zT
Determines whether an IP address falls within one of the private IP ranges
r5 zfe80:FTi
i���
l P l �Q l X l �?X i i���)�
startswithr� )r� �addrr+ r+ r, � is_public_ip� s$
����r� c C s0 t �d|� d��}|�| �rtd�| |���dS )zF
Check whether the specified name contains invalid characters
z[^�]zU{} contains characters not supported by this cloud provider. Valid characters are: {}N)�re�compiler� r rD )rn Z
safe_charsZregexpr+ r+ r, �
check_name� s
��r� c C s� |du r)dt jv rd�t jd �}nz
d�t�t �� �j�}W n ty( Y nw |dur5t� d| |� nt� d| � t
� dd| g� dS )z1
Remove a host from the known_hosts file
N�HOMEz{}/.ssh/known_hostsz0Removing ssh key for %s from known hosts file %sz-Removing ssh key for %s from known hosts filez
ssh-keygenz-R) rM r� rD �pwd�getpwuid�getuidZpwd_dirr� r rf r� �call)r� Z known_hostsr+ r+ r, �
remove_sshkey� s
� � r� r� c C s� |du rd}|du r i }|} t �dt|d �t|d �� | |i |��}|du r<t �d|� |d8 }|d kr;td
��n|durB|S |d k rVtd �t|d �t|d ����t�|� ||8 }|dkru||9 }||kro|d }t �d |� q)
as
Helper function that waits for an IP address for a specific maximum amount
of time.
:param update_callback: callback function which queries the cloud provider
for the VM ip address. It must return None if the
required data, IP included, is not available yet.
:param update_args: Arguments to pass to update_callback
:param update_kwargs: Keyword arguments to pass to update_callback
:param timeout: The maximum amount of time(in seconds) to wait for the IP
address.
:param interval: The looping interval, i.e., the amount of time to sleep
before the next iteration.
:param interval_multiplier: Increase the interval by this multiplier after
each request; helps with throttling
:param max_failures: If update_callback returns ``False`` it's considered
query failure. This value is the amount of failures
accepted before giving up.
:returns: The update_callback returned data
:raises: SaltCloudExecutionTimeout
Nr+ Tz-Waiting for VM IP. Giving up in 00:%02d:%02d.r Fz^'update_callback' has returned 'False', which is considered a failure. Remaining Failures: %s.r r z<Too many failures occurred while waiting for the IP address.z&Unable to get IP for 00:{:02d}:{:02d}.z3Interval multiplier in effect; interval is now %ss.) r rf r� r r rD r� r� r ) Zupdate_callbackZ update_argsZ
update_kwargsr� �intervalZinterval_multiplierZ max_failuresZdurationr� r+ r+ r, � wait_for_ip� sN
������
�r� c C s� |dkrt d��d| v rt d�| d d d d ���i }| D ] }i }| | }|D ]}t|�|v r9|| }|||< q)|||< q |S )zO
Return a list of the VMs that are on the provider, with select fields
�actionzDThe list_nodes_select function must be called with -f or --function.r� z)An error occurred while listing nodes: {}ZErrorsr� �Message)r rD r$ ) �nodesZ selectionr� r� �node�pairsr� rc r� r+ r+ r, �list_nodes_selectH
s* ��� �
r� r� c C s� t �d| � | d }t�� } tj�|�r+t�� | |kr%t �d| � dS t�|� nnqtj j
� |d�� W d � dS 1 sAw Y dS )z�
Lock a file; if it is already locked, then wait for it to become available
before locking it.
Note that these locks are only recognized by Salt Cloud, and not other
programs or platforms.
z Attempting to obtain lock for %s�.lockTz Unable to obtain lock for %sF�aN) r r@ r� rM r' r[ r� r� r r r r )�filenamer� r� �lockr� r+ r+ r, � lock_filee
s � "�r� c
C sZ t �d| � | d }zt�|� W dS ty, } zt �d| |� W Y d}~dS d}~ww )z�
Unlock a locked file
Note that these locks are only recognized by Salt Cloud, and not other
programs or platforms.
zRemoving lock for %sr� z Unable to remove lock for %s: %sN)r r@ rM r_ r� )r� r� r� r+ r+ r, � unlock_file}
s ��r� c C s� t |�}tj�|d�}t|� tj�|�r<tjj� |d��}tjj
� tjj j
|td��}W d � n1 s6w Y ni }|�d�}|�| | |||d d�i� tjj� |d��}tjj j||td� W d � n1 snw Y t|� dS ) a�
Add an entry to the cachedir index. This generally only needs to happen when
a new instance is created. This entry should contain:
.. code-block:: yaml
- minion_id
- profile used to create the instance
- provider and driver name
The intent of this function is to speed up lookups for the cloud roster for
salt-ssh. However, other code that makes use of profile information can also
make use of this function.
�index.p�rb��encodingNr5 r )ro r� r� r� �wb)�
init_cachedirrM r' rE r� r[ r r r r r� �decode�msgpack�load�MSGPACK_ENCODINGrC rx �dumpr� ) r� r� r� r� �base�
index_file�fh_�indexZ
prov_compsr+ r+ r, �cachedir_index_add�
s2 � ��
��� � r� c C s� t |�}tj�|d�}t|� tj�|�r<tjj� |d��}tjj
� tjj j
|td��}W d � n1 s6w Y ndS | |v rE|| = tjj� |d��}tjj j||td� W d � n1 sbw Y t|� dS )zw
Delete an entry from the cachedir index. This generally only needs to happen
when an instance is deleted.
r� r� r� Nr� )r� rM r' rE r� r[ r r r r r� r� r� r� r� r� r� )r� r� r� r� r� r+ r+ r, �cachedir_index_del�
s" � �� � r� c C s^ | du rt d } | tj�| d�tj�| d�f}|D ]}tj�|�s&t�|� t�| d� q| S )zP
Initialize the cachedir needed for Salt Cloud to keep track of minions
N�cachedir� requested�activei� )r� rM r' rE r[ r\ �chmod)r� Z needed_dirsZdir_r+ r+ r, r� �
s
r� c
C s� |du rt d }|s |dur tjjj||r|�d�pdd�}t|� | ||d�}| � d�}tj� |d|�}tjj
� |d ��} tjj j
|| td
� W d � dS 1 sSw Y dS ) a�
Creates an entry in the requested/ cachedir. This means that Salt Cloud has
made a request to a cloud provider to create an instance, but it has not
yet verified that the instance properly exists.
If the fingerprint is unknown, a raw pubkey can be passed in, and a
fingerprint will be calculated. If both are empty, then the fingerprint
will be set to None.
Nr� rm rj )rc Zsum_type)r� � fingerprintr� �.pr� r� r� )r� r r rS Z
pem_fingerrB r� rM r' rE r r r� r� r� )
r� r r� Zpubkeyr� r� r� �fnamer' r� r+ r+ r, �request_minion_cachedir�
s ��
"�r� c C s� t |t�sdS |du rtd }| � d�}tj�|||�}tjj� |d��}tjj
� tjj j
|td��}W d � n1 s=w Y |�|� tjj� |d��}tjj j||td� W d � dS 1 sew Y dS )a�
Changes the info inside a minion's cachedir entry. The type of cachedir
must be specified (i.e., 'requested' or 'active'). A dict is also passed in
which contains the data to be changed.
Example:
change_minion_cachedir(
'myminion',
'requested',
{'fingerprint': '26:5c:8c:de:be:fe:89:c0:02:ed:27:65:0e:bb:be:60'},
)
FNr� r� r r� �w)r� re r� rM r' rE r r r r r� r� r� r� r� rx r� )r� r� r� r� r� r' r� �
cache_datar+ r+ r, �change_minion_cachedir s
� �
"�r c C sH |du rt d }| � d�}tj�|d|�}tj�|d�}t�||� dS )z�
Moves a minion from the requested/ cachedir into the active/ cachedir. This
means that Salt Cloud has verified that a requested instance properly
exists, and should be expected to exist from here on out.
Nr� r� r� r� )r� rM r' rE rU �move)r� r� r� �src�dstr+ r+ r, �activate_minion_cachedir2 s
r c C s� t |t�r
t�|� t�dd�du rdS |du r td }tttd | �� ��}| � d�}dD ] }tj �
|||||�}t � d|� tj �
|�rLt�|� q/dS ) z�
Deletes a minion's entry from the cloud cachedir. It will search through
all cachedirs to find the minion's cache file.
Needs `update_cachedir` set to True.
�update_cachedirFNr� � providersr� )r� r� zpath: %s)r� re r� rx rB �next�iterr� rM r' rE r rf r[ r_ )r� r� r r� r� r� r� r' r+ r+ r, �delete_minion_cachedirA s
��r
c C s" | du rt } | �dd�du rdS |du r tj�| d d�}i }t�|�D ]j}i ||< tj�||�}t�|�D ]W}|r?||kr?q6i || |< tj�||�}t�|�D ];}tj�||�} |dd� }
tjj� | d�� } tjj
� tjj j
| td��|| | |
< W d � n1 s�w Y qQq6q$|S ) z�
Return a list of minion data from the cloud cache, rather from the cloud
providers themselves. This is the cloud cache version of list_nodes_full().
Nr Fr� r� ���r� r� )r� rB rM r' rE �listdirr r r r r� r� r� r� r� ) r r� r� rY r� �prov_dirZprovZmin_dirr� Zfpathr� r� r+ r+ r, �list_cache_nodes_fullY s6 � ����r c C s" | � dd�}|s
|}|std��|�d�sd|v rXt�d� zddl}W n
ty1 d d
i Y S w |j |d d �}|jd
krGd d�||j�iS |j }||krQd}n@t
j � |�}n9t
j �
|�r�tjj�|��}tjj�|�� �}W d � n1 syw Y t
j � |�}n |}t�|��� � d�}|s�td��t
j �t
j �t�d�}t
j �t
j �| d �d�} t
j �| d d�}
g } | � dg �D ] } | �|�r�q�| | |
fv r�| �| df� q�| �| df� q�| | vr�| �| df� |
| vr�| �|
df� g }
g }| D ]�\} }| |
v �rq�|
�| � |�r4t
j � | ��s4zt
� | � W n t �y3 } z t� d| � W Y d}~q�d}~ww t | ��s@t�d| � q�t
j �| |�}z*|�|� tjj�|d��}|�!tjj�"|�� W d � n 1 �skw Y W q� t �y� } z t�d |� W Y d}~q�d}~ww d d |iiS ) z�
Update the salt-bootstrap script
url can be one of:
- The URL to fetch the bootstrap script from
- The absolute path to the bootstrap
- The content of the bootstrap script
Zbootstrap_script_urlzVhttps://github.com/saltstack/salt-bootstrap/releases/latest/download/bootstrap-salt.shz Cant get any source to update�httpz://z6Updating the bootstrap-salt.sh script to latest stabler Nr� zZUpdating the bootstrap-salt.sh script requires the Python requests library to be installed�x )r� �� zdFailed to download the latest stable version of the bootstrap-salt.sh script from {}. HTTP error: {}zbootstrap-salt.shrJ z No content in bootstrap script !r� r� zcloud.deploy.dZ
config_dirrK TFz Failed to create directory '%s'z(The '%s' is not writeable. Continuing...r� z&Failed to write the updated script: %sZSuccessz
Files updated)#rB r� r� r rf �requests� ImportErrorrC rD �textrM r' r� r[ r r r r r! r" r# �hashlib�sha1� hexdigestrE r� �__file__r� r� r\ r� r r
r] r^ )rv rA Z default_urlr ZreqZscript_content� script_nameZficZbuiltin_deploy_dirZdeploy_d_from_conf_fileZdeploy_d_from_syspathsZdeploy_scripts_search_paths�entry�finishedZ
finished_fullr\ r� Z deploy_pathr) r+ r+ r, �update_bootstrap s�
�
��
� ��
��
�� �� r c C s� d|vs|d s
dS t j�t� d�}tt|d | �� ��}t j�|||�}t j�|�s1t �|� t || ||� | D ]9}t
||| | |� t j�||� d��}t j j
�|d��}t j jj| | |td� W d � n1 snw Y q:dS )z�
If configured to do so, update the cloud cachedir with the current list of
nodes. Also fires configured events pertaining to the node list.
.. versionadded:: 2014.7.0
r Nr� r r� r� r� )rM r' rE r� r r r� r[ r\ �missing_node_cache�diff_node_cacher r r r r� r� r� ) r� r� r r� r� r
r� r' r� r+ r+ r, �cache_node_list� s
���r c C s� t |t�r
t�|� dtvstd sdS tj�tj�td d��s$t� tj�td d�}|� d�\}}tj�|||�}tj�|�sGt�
|� tj�|d� | d ��}t j
j�|d��}t j
jj| |td � W d � dS 1 sqw Y dS )
zA
Cache node individually
.. versionadded:: 2014.7.0
r Nr� r� r5 z{}.prn r� r� )r� re r� rx rM r' r[ rE r� rC r\ rD r r r r r� r� r� )r� r� r r� r� r
r' r� r+ r+ r, �
cache_node s
"�r c
C s� g }t �| �D ]
}|�t j�|�d � q|D ]3}||vrJt|||� d|v rJ|d rJtddd|� d�d|i|�dt j�t d d ��|�d
d �d � qd
S )ag
Check list of nodes to see if any nodes which were previously known about
in the cache have been removed from the node list.
This function will only run if configured to do so in the main Salt Cloud
configuration file (normally /etc/salt/cloud).
.. code-block:: yaml
diff_cache_events: True
.. versionadded:: 2014.7.0
r �diff_cache_eventsr� z!cached node missing from providerrd z/cache_node_missingz missing noder� rk r� r� r� N)
rM r r� r' �splitextr
r� rB rE r� )r
Z node_listr� r Z cached_nodesr� r+ r+ r, r - s&
�
���r c C sl d|vs|d s
dS |du rdS t j�| |�� d�}t j�|�sFt||�}tddd|� d�d|i|�d t j�td d
��|�d d �d
� dS tj j
� |d��*}ztj j �
tj jj|td��}W n typ t�d|� i }Y nw W d � n1 s{w Y tj j�||�}|dkr�tddd|� d�t||�t||�d�|�d t j�td d
��|�d d �d
� dS dS )aX
Check new node data against current cache. If data differ, fire an event
which consists of the new node data.
This function will only run if configured to do so in the main Salt Cloud
configuration file (normally /etc/salt/cloud).
.. code-block:: yaml
diff_cache_events: True
.. versionadded:: 2014.7.0
r! Nr� r� znew node foundrd z/cache_node_new�new_datar� rk r� r� r� r r� z"Cache for %s was corrupt: Deletingr znode data differsz/cache_node_diff)r# r )rM r' rE r[ �_strip_cache_eventsr� rB r� r r r r r� r� r� r� r� r� r r� �compat�cmp) r
r� r# r r' �
event_datar� r �diffr+ r+ r, r O sP
�� �� �
�
��r c C s2 t �| �}|�dg �}|D ] }||v r||= q
|S )a9
Strip out user-configured sensitive event data. The fields to be stripped
are configured in the main Salt Cloud configuration file, usually
``/etc/salt/cloud``.
.. code-block:: yaml
cache_event_strip_fields:
- password
- priv_key
.. versionadded:: 2014.7.0
Zcache_event_strip_fields)r{ r| rB )r� r r' Z strip_fields�fieldr+ r+ r, r$ � s
�r$ c C s\ t | ttf�std| � ���ddd�}| j| j| j� |v r,|| j| j| j� | jfS | �)a~
Helper method to try its best to convert any Unicode text into ASCII
without stack tracing since salt internally does not handle Unicode strings
This method is not supposed to be used directly. Once
`py:module: salt.utils.cloud` is imported this method register's with
python's codecs module for proper automatic conversion in case of encoding
errors.
z
Can't handle r9 �-)� u –)r� �UnicodeEncodeError�UnicodeTranslateError� TypeError�objectr� �end)r� Z
unicode_transr+ r+ r, �_salt_cloud_force_ascii� s
� r1 zsalt-cloud-force-asciic C s6 z ddl }|�| |�W S ty t�d� Y dS w )za
Retrieve particular user's password for a specified credential set from system keyring.
r NzHUSE_KEYRING configured as a password, but no keyring module is installedF)�keyringZ get_passwordr r r� )�
credential_idr� r2 r+ r+ r, � retrieve_password_from_keyring� s ��r4 c C s8 z ddl }|�| ||�W S ty t�d� Y dS w )z3
Saves provider password in system keyring
r N�FTried to store password in keyring, but no keyring module is installedF)r2 Z set_passwordr r r� )r3 r� r� r2 r+ r+ r, �_save_password_in_keyring� s ��r6 c
C s� zRddl }ddl}|du r,d| � d�}zt�|�}W n ty% d}Y nw |s,td��z
t| ||� W W dS |jjyR } zt� d|� W Y d}~W dS d}~ww t
ya t� d� Y dS w ) zS
Interactively prompts user for a password and stores it in system keyring
r NzPlease enter password for z: zInvalid password provided.z*Problem saving password in the keyring: %sr5 F) r2 Zkeyring.errors�getpass�EOFError� RuntimeErrorr6 �errorsZPasswordSetErrorr rf r r� )r3 r� r� r2 �promptr� r+ r+ r, �store_password_in_keyring� s0 � �� ��r< c C s |� d�}|D ]}| | } q| S )z�
Accepts index in form of a string
Returns final value
Example: dictionary = {'a': {'b': {'c': 'foobar'}}}
index_string = 'a,b,c'
returns 'foobar'
rV )rC )Z
dictionaryZ index_stringr� �kr+ r+ r, � _unwrap_dict
s
r> c C s� d}||krK| ||d�}i }|D ] }t |t�r-|d } t | t�r-| �� D ]\}
} | ||
< q$qt||�}t�dt| ��d�d ||� t �
d� ||ksdS ) z�
Waits until the function retrieves some required argument.
NOTE: Tested with ec2 describe_volumes and describe_snapshots only.
N)r� r z+Function: %s, Watched arg: %s, Response: %sr9 r r� T) r� r� re r� r> r rf r$ rC r� r� ) r� rH Zfun_callZargument_being_watchedZrequired_argument_responser Zf_resultZr_set�dZd0r= �vr+ r+ r, �run_func_until_ret_arg
s*
�
�
�rA c C s8 t jjd| |ddd�}|du rt jjd| |ddd�}|S )zk
Return the salt_interface type to connect to. Either 'public_ips' (default)
or 'private_ips'.
Zsalt_interfaceFrq Z
ssh_interfaceZ
public_ips)r rv rw )r( r r� r+ r+ r, �get_salt_interface/
s
�
�rB c C sN t j�|�st�d|| � dS t�t �|�j�}|dvr%t�d|| � dS dS )aL
Checks that the key_path exists and the key_mode is either 0400 or 0600.
Returns True or False.
.. versionadded:: 2016.3.0
provider
The provider name that the key_path to check belongs to.
key_path
The key_path to ensure that it exists and to check adequate permissions
against.
zJThe key file '%s' used in the '%s' provider configuration does not exist.
F)r� i� z`The key file '%s' used in the '%s' provider configuration needs to be set to mode 0400 or 0600.
T)rM r' r[ r r� r� �S_IMODEr� )r� rb Zkey_moder+ r+ r, �check_key_path_and_mode@
s ��rD c
C s� |du r|S t jjd|| ddd�}|du r|S |du r | �d�n|}|du r(|S | �� }|�|� t j�|i �}| d }| d }t jj d|||||d�} t
| t �spz
d � | �
� �} W | S tyo t�d
| � t | �} Y | S w | S ) zL
Use the configured templating engine to template the userdata file
N�userdata_templateFr� Zrenderer_blacklistZrenderer_whitelistz:string:)Z
input_datar zKTemplated userdata resulted in non-string result (%s), converting to string)r rv rw rB r{ rx �loaderr% r* Zcompile_templater� r$ rE � readlinesr& r r� )
r r( ZuserdatarE ZrendererZ render_optsZrendZ blacklistZ whitelistZ templatedr+ r+ r, rE e
sN
�
��
�
��
�rE )NNr )rQ )r~ r )r� )r� )r� TT)r� Nr r ) r4 r� r8 NNr� r TNr� N)r� r� r� NNNNNFNNNFNNr� NNNrX NNFr� TT)&r4 r� r8 NNNNNNNNFNNNNNNFNNr� r� FTTNFNFNNNr� NNNF)Nr4 r� r8 NNr� TFNFNNNr� )Nr� )NF)NNN)F)NNr� )NNr� r� r r )r� r� )Nr NNNr� )�r! �codecsr{ r� r �loggingr_ rM r� r� rU r� r� r� rR r� r� r) Zjinja2r Z salt.clientr Z
salt.cloudZ salt.configZ
salt.cryptZ salt.loaderZ
salt.templateZsalt.utils.compatZsalt.utils.cryptZsalt.utils.dataZsalt.utils.eventZsalt.utils.filesZsalt.utils.msgpackZsalt.utils.pathZsalt.utils.platformZsalt.utils.stringutilsZsalt.utils.versionsZ
salt.utils.vtZsalt.utils.yamlZsalt.exceptionsr r r r r r Zsalt.utils.nb_popenr Zsalt.utils.validate.pathr
Zsalt.utils.smbZHAS_SMBr Zpypsexec.clientr r Zpypsexec.exceptionsr Z
pypsexec.scmrr
r Zsmbprotocol.exceptionsr r Zsmbprotocol.treer � getLogger�setLevel�WARNINGZ
HAS_PSEXECrg Z
pkg_resourcesr= Zwinrm.exceptionsr Zget_distributionZ winrm_pkgr ZversionsZcompare�versionrf r� �platformZ
is_windowsr7 Z HAS_GETPASSr� ZNSTATESr� �Mr� r� rF rG r r r- r3 rI rP rT re rg ri rz r} rL r� r� r� r r( r/ r2 r7 rG rM rN rU rW r� r� r� r� r� r� r� r� r� r& rk rT r� r� r� r� r� r� r� r� r� r� r� r� r� r r r
r r r r r r r$ r1 �register_errorr4 r6 r< r> rA rB rD rE r+ r+ r+ r, �<module> s@ � �
�� �����
9
.
� -
a
�3
�
�
�K
� g
� a
�c
!
6
e
l
P
�
J
.
�*
�
'
&{"=
!
�! %