File: //opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/__pycache__/thin.cpython-310.pyc
o
�N�gb � @ s d Z ddlZddlZddlZddlZddlZddlZddl Z ddl
Z
ddl Z ddl Z ddl
Z
ddlZddlZddlZddlZddlZddlZddlZddlZddlZddlm mZ ddlZddlZddl Zddl Zddl Zddl ZdZ zddl!Z!dZ W n e"y� Y nw zddl#Z#W n e"y� dZ#Y nw zddl$Z$W n e"y� dZ$Y nw zddl%Z%W n e"y� dZ%Y nw zddl&Z&W n e"y� dZ&Y nw zddl'Z'W n e"y� ddl(m m'Z' Y nw zddl)Z)W n e"y� dZ)Y nw zddl*m+Z+ W n e"�y! zddl,m+Z+ W n e"�y dZ+Y nw Y nw dZ-e�.e/�Z0dd� Z1dd � Z2d
d � Z3d d
� Z4dd� Z5dd� Z6dd� Z7dd� Z8d/dd�Z9dd� Z:dd� Z;d0d d �Z<d d � Z=d!d"� Z>d#d$� Z? % d1d&d'�Z@d2d)d*�ZA d3d+d,�ZBd2d-d.�ZCdS )4z@
Generate the salt thin tarball from the installed python files
� NFT)�ssl_match_hostnamec C sj z t j�| |�}W n ty d}Y nw |dur3t j�|�}z |j�|� W |S ty2 Y dS w dS )z�
Import a module from a specific path. Path can be a full or relative path
to a .py file.
:name: The name of the module to import
:path: The path of the module to import
N)� importlib�util�spec_from_file_location�
ValueError�module_from_spec�loader� exec_module�OSError)�name�path�spec�lib� r �C/opt/saltstack/salt/lib/python3.10/site-packages/salt/utils/thin.py�
import_module^ s � ���r c C sP t td�r t�� S tjD ]} tdtj�| d��}t |d�r#|�� S q td��)a�
Some versions of Virtualenv ship a site.py without getsitepackages. This
method will first try and return sitepackages from the default site module
if no method exists we will try importing the site module from every other
path in sys.paths until we find a getsitepackages method to return the
results from. If for some reason no gesitepackages method can be found a
RuntimeError will be raised
:return: A list containing all global site-packages directories.
�getsitepackages�sitezsite.pyz)Unable to locate a getsitepackages method) �hasattrr r �sysr r �os�join� RuntimeError)r r r r r r t s
�r c C s� g }g }zt � }W n ty t�d� Y nw |D ],}tj�|| � d��}t| |�}|r2|�|� tj�|| d�}t| |�}|rF|�|� q|S )z�
Finds and imports a module from site packages directories.
:name: The name of the module to import
:return: A list of imported modules, if no modules are imported an empty
list is returned.
z!No site package directories found�.py� __init__.py) r r �log�debugr r r r �append)r ZlibsZ
site_pathsZ site_pathr r r r r �find_site_modules� s$
�
�r c O sB d}d| fd|ffD ]\}}|� |tjj�|��}q
tjj�|�S )a%
Return salt-call source, based on configuration.
This will include additional namespaces for another versions of Salt,
if needed (e.g. older interpreters etc).
:dirs: List of directories to include in the system path
:namespaces: Dictionary of namespace
:return:
a� # -*- coding: utf-8 -*-
import os
import sys
# Namespaces is a map: {namespace: major/minor version}, like {'2016.11.4': [2, 6]}
# Appears only when configured in Master configuration.
namespaces = %namespaces%
# Default system paths alongside the namespaces
syspaths = %dirs%
syspaths.append('py{0}'.format(sys.version_info[0]))
curr_ver = (sys.version_info[0], sys.version_info[1],)
namespace = ''
for ns in namespaces:
if curr_ver == tuple(namespaces[ns]):
namespace = ns
break
for base in syspaths:
sys.path.insert(0, os.path.join(os.path.dirname(__file__),
namespace and os.path.join(namespace, base) or base))
if __name__ == '__main__':
from salt.scripts import salt_call
salt_call()
z%dirs%z %namespaces%)�replace�salt�utils�json�dumps� stringutils�to_bytes)�dirs�
namespaces�templateZtgtZcntr r r �_get_salt_call� s
r) c C s t j�| dd�S )z-
Return the path to the thin tarball
�thinzthin.tgz)r r r )�cachedirr r r � thin_path� s r, c C s g d�}t j�| �|v S )zj
Return True if module is share-able between major Python versions.
:param mod:
:return:
)r �jinja2�msgpack�certifi)r r �basename)�modZ shareabler r r �
_is_shareable� s r2 c C sL t j�|j��d�d dkr| �t j�|j�� dS | �|j�dd�� dS )z]
Add a dependency to the top list.
:param obj:
:param is_file:
:return:
�.r �__init__�.pycr N)r r r0 �__file__�splitr �dirnamer )� container�objr r r �_add_dependency� s r; c C s4 t jj�tjd �} tdi | ��}t jjj|dd�S )z�
This function is called externally from the alternative
Python interpreter from within _get_tops function.
:param extra_mods:
:param so_mods:
:return:
� F)� ensure_asciiNr )r r! r" �loadsr �argv�get_topsr# )�extra�topsr r r �gte� s rC c C s i }g d�}|rt |�dkr|�d� |D ]l}|r ||v r qtjj�| �s/t�d| � i S | dd�|�g}t j
|t j d�}|� � \}} t
j�tjj�|��d��}
|r[t
j�|
�sct�d || � qt
j�|
��d
�d d krwt
j�|
�}
n|
�d
d�}
|
||< q|S )a�
Get top directories for the ssh_ext_alternatives dependencies
automatically for the given python version. This allows
the user to add the dependency paths automatically.
:param py_ver:
python binary to use to detect binaries
:param exclude:
list of modules not to auto detect
:param ext_py_ver:
the py-version from the ssh_ext_alternatives config
)
r- �yaml�tornador. r/ �singledispatch�
concurrent�singledispatch_helpersr �
markupsafe�
backports_abc� looseversion� packaging�� r �distroz5%s does not exist. Could not auto detect dependenciesz-cz import {0}; print({0}.__file__))�stdout�
zGCould not auto detect file location for module %s for python version %sr3 r r4 Zpyc�py)�tupler r r! r �whichr �error�format�
subprocess�Popen�PIPE� communicater �abspath�data�decode�rstrip�existsr0 r7 r8 r ) �py_ver�exclude�
ext_py_ver�files�modsr1 Z py_shell_cmd�cmdrP �_Zmod_filer r r �get_tops_python s4
�
rg c C s� t �| �pi } i }g d�}g }| �� D ]�\}}|||< |�d�}d}|s'd}n t|ttf�s0d}|r8tj� |��t|�dkrGd|vrG|�
d� |�d�d krRt d
��|�d�D ]O}|d | p`d } | sjt �
d |� qW| �d
�r}tj�| �s}t �
d|| � qW| �d
�s�tj�tj�| d��s�t �
d|| � qW|�
| � ||v r�|�|�|�� qWd�|�}|r�d�|�}
t �|
� tjj |
d��||| d< q|S )zb
Get top directories for the dependencies, based on external configuration.
:return:
)r- rD rE r. �
py-versionNz@Alternative Salt library: missing specific locked Python versionz`Alternative Salt library: specific locked Python version should be a list of major/minor versionrM rO � dependenciesZinheritz#This feature is not yet implemented� z#Module %s has missing configurationr z:Module %s configured with not a file or does not exist: %sr z3Module %s is not a Python importable module with %sz, zRMissing dependencies for the alternative version in the external configuration: {})�msg)�copy�deepcopy�items�get�
isinstancerS �listr �
exceptions�SaltSystemExitr �NotImplementedErrorr �warning�endswithr r �isfiler �pop�indexrV rU ) �configZ alternatives�requiredrB �ns�cfgZlocked_py_version�err_msg�depr1 rk r r r � get_ext_tops? sf
�
� ��
�
�
r� c C sF i }| s|S | D ]}t | | �dg ��}|s tj�d��|||< q|S )zZ
Get namespaces from the existing configuration.
:param config:
:return:
rh ztAn alternative version is configured, but not defined to what Python's major/minor version it should be constrained.)rS ro r rr rs )rz r' r| Zconstraint_versionr r r �_get_ext_namespaces� s �
r� rj c C s� g }t ttttttttt t
t t t
tg}td�}|r |d }nt}t�d|� |�|� tr2|�t� |D ]}|rDt�d|j� t||� q4dd� | �d�D �D ][}|t� vr�|t� vr�z3t|�t� |< t j �t� | j �\}}t j � |�\} }
| dkr�|�|� n |�t j � || d �� W qO t!y� } ztj"d
|| d d � W Y d
} ~ qOd
} ~ ww qOdd� |�d�D �D ].}zt|�t� |< |�t� | j � W q� t!y� } ztj"d|d d � W Y d
} ~ q�d
} ~ ww |S )z�
Get top directories for the dependencies, based on Python interpreter.
:param extra_mods:
:param so_mods:
:return:
� contextvarsr zUsing contextvars %rz Adding module to the tops: "%s"c S � g | ]}|r|�qS r r ��.0�mr r r �
<listcomp>� � z get_tops.<locals>.<listcomp>�,r4 r z&Unable to import extra-module "%s": %sT)�exc_infoNc S r� r r r� r r r r� � r� z Unable to import so-module "%s")#r rO r- rD rE r. r/ rF rG rH r rI rJ rK rL r �py_contextvarsr r r �has_immutables�
immutables�__name__r; r7 �locals�globals�
__import__r r r6 �splitextr � ImportErrorrU ) �
extra_mods�so_modsrB rd �modulesr� r1 Zmoddir�modname�baserf �errr r r r@ � sp �
� ����� ��r@ c C s� g }t �| ��� D ]\}} t|�}|dkr|�d� q |dkr$|�d� q t �|�p+i }|�� D ]\}}|�dj|g|�d��R � � q0|�d� tjj �
t j �
|��S )a�
Based on the Salt SSH configuration, create a YAML configuration
for the supported Python interpreter versions. This is then written into the thin.tgz
archive and then verified by salt.client.ssh.ssh_py_shim.get_executable()
Note: Current versions of Salt only Support Python 3, but the versions of Python
(2.7,3.0) remain to include support for ssh_ext_alternatives if user is targeting an
older version of Salt.
:return:
� zpy2:2:7rN zpy3:3:0z{}:{}:{}rh rj )rl rm rn �intr rV ro r r! r$ r% r �linesepr )rB � extended_cfgZpymapr` Zcfg_copyr| r} r r r �_get_supported_py_config� s
�
r� c C s6 t jtj�| �dtj�| �d d�\}}t�|� |S )z�
Make sure thintar temporary name is concurrent and secure.
:param tarname: name of the chosen tarball
:return: prefixed tarname
z.thin-r< )�dir�prefix�suffix)�tempfileZmkstempr r r8 r� �close)ZtarnameZtfdZ tmp_tarnamer r r �_get_thintar_prefix� s
�
r� c C sx t �| �}|�� D ]U\}}|�d�r^dt|�ddg�d � }|�d�r(|d }g }|| �d�}|r@|�� D ]} |�| � q7ni || d< t|||d d�}
|
D ] } |
| || d | < qQq t|��� D ]�\}}|�d �g|�d� } |�d�\} }
| D ]�}t j
� |�}t j
� |�t j
�
|�}}t �|� t|�r�d
p�d | � �}t�d |||� t j
�|�s�t�d
|� q}t j
�|�s�t j
�t j
�||��r�|j|t j
�|||�d� q}tjj
j|dd�D ]X\}}}|D ]P}|�d��s6|�t j
�||�� t j
�||||�}t|d��r'z|� t j
�|||�� d }W n t �y& t�d|� Y nw |�r6|jt j
�||�|d� q�q�q}qed S )NZ auto_detect�pythonrh rj r Zpy_binri )ra rb r �pyallrR z/Packing alternative "%s" to "%s/%s" destinationz;File path %s does not exist. Unable to add to salt-ssh thin��arcnameT�� followlinks�r5 z.pyo�getinfo�&ZIP: Unable to add "%s" with "getinfo") rl rm rn ro �str�keysr rg r� r r �normpathr0 r8 �chdirr2 r r r_ rU �isdirr �addr r! �os_walkrv r r� �KeyError)r� �digest_collector�tfprz r| r} r` ra Zdepsr Z auto_depsrB Z py_ver_majorZ py_ver_minor�topr� � top_dirname� site_pkg_dir�rootr& rc r r� r r r �_pack_alternative s~
�
��
� � �������r� �gzipc % C sl t jdk r tj�d��|dvrt�d|� d}tj� | d�}tj�
|�s)t� |� tj� |d|dkr4dp5d �}tj� |d
�} tj� |d �}
tj� |d �} tj� |d
�} tj� |d�}
tj j
�� }tj j�| d��}|�td*i t|���� W d � n1 s�w Y tj�|��r |s�tj�| �r�tj j�| ��}|�� tjjk}W d � n1 s�w Y |du r�tj�|
�r�tj j�|
��}|�� tt jd �k}W d � n1 s�w Y nd}|�r z
t�d|� t�|� W n, t�y } z t� d||� tj� |��rtj�d� |���W Y d}~nd}~ww |S d}i }t ||d�}||t jj < tj j�| d��}|�t!||d�� W d � n 1 �sLw Y t"|�}|dk�rct#j$|ddd �}n|d k�r|t%j&|d t'�rst%j(�put%j)d �}|j|_*zt�+� }W n t�y� d}Y nw d}t�d � |�,� D ]�\}}|D ]�}|�r�tj�-|��s��q�tj�.|�}tj�/|�} tj�
| ��r�t�0| � nt1�2� }t%�&| �} | �3|� tj� ||�}t�0|� t4|��r�d�p�d |� �} t�d!|| � tj�
|��stj� tj� | |���r|j*|tj� | |�d"� �q�tj jj5|dd#�D ]Y\} } }!|!D ]P}"|"�6d$��su|�*tj� | |"�� tj� | | |"�}#t7|d%��rfz|�8tj� | | |"�� d}#W n t9�ye t�d&|#� Y nw |#�ru|j*tj� | |"�|#d"� �q&�q |du�r�t:�;|� d}�q��q�|�r�t�d'� t<|||� t�0|� tj j�| d(��}|�tjj� W d � n 1 �s�w Y tj j�|
d(��}|�tt jj �� W d � n 1 �s�w Y tj j�|
d(��}|�|�=� � W d � n 1 �s�w Y t�0tj�/| �� d)D ]}$|�*|$� �q |�r*t�>|tj?��r*t�>|tj@��r*t�0|� |�A� t:�B||� |S )+a�
Generate the salt-thin tarball and print the location of the tarball
Optional additional mods to include (e.g. mako) can be supplied as a comma
delimited string. Permits forcing an overwrite of the output file as well.
CLI Example:
.. code-block:: bash
salt-run thin.generate
salt-run thin.generate mako
salt-run thin.generate mako,wempy 1
salt-run thin.generate overwrite=1
)rN z;The minimum required python version to run salt-ssh is "3".)r� �zipzCUnknown compression type: "%s". Falling back to "gzip" compression.r� r* zthin.�tgzr� �version�.thin-gen-py-version� salt-call�supported-versions�
code-checksum�wbr� NFr TzRemoving %s archive filez Error while removing %s file: %sz/Unable to remove {} file. See logs for details.z$Failed %s tops for Python binary %s.�r� r� )rB r� �w:gz�� dereference�w)� compressionz7Packing default libraries based on current Salt versionrR z Packing "%s" to "%s" destinationr� r� r� r� r� z4Packing libraries based on alternative Salt versions�w+)r� r� r� r� r� )r� )Cr � version_infor rr rs r ru r r r r� �makedirsr! � hashutilsZDigestCollectorrc �fopen�writer) r� rw �readr� � __version__r� r �remover
rU r_ rV r@ �majorr� r� �tarfile�open�zipfile�ZipFile�zlib� ZIP_DEFLATEDZ
ZIP_STOREDr� �getcwdrn �isabsr0 r8 r� r� �mkdtemp�
extractallr2 r� rv r r� r� �shutil�rmtreer� �digest�access�R_OK�X_OKr� �move)%r+ r� � overwriter� Zabsonly�compressr� Zthindir�thintarZthinverZ pythinver� salt_callZ pymap_cfg�
code_checksumr� �fp_�fh_�excZtops_failure_msg�tops_py_version_mappingrB Z tmp_thintarr� � start_dir�tempdirr` r� r� r� �eggr� r� r& rc r r� �fnamer r r �gen_thinJ s
��
� � �� �� ��� �� �
� �
����
��,
� � �&
r� �sha1c C s� t | �}tj�| dd�}tj�|�r5tjj�|d��}d|� � �
� � d�}W d � n1 s/w Y nd}|tjj � ||�fS )�9
Return the checksum of the current thin tarball
r* r� �r�'Nz'0')
r� r r r rw r r! rc r� r� �stripr� �get_hash)r+ �formr� Zcode_checksum_pathZfhr� r r r �thin_sum� s ��r� c C s� t j�| d�}t j�|�st �|� t j�|d�}t j�|d�}t j�|d�}t j�|d�}tjj�|d��} | � t
� � W d � n1 sGw Y t j� |�r�|s�t j� |�r�tjj�|��}
|
� � tj
jk}W d � n1 stw Y |du r�t j� |�r�tjj�|��}
|
� � ttjd �k}W d � n1 s�w Y nd
}|r�zt �|� W n ty� Y nw |S i } t||d �} | | d < tj|d
d
d�}
zt �� }W n ty� d}Y nw d}d}| �� D ]�\}} | D ]�}t j�|�}t j�|�}t j�|��r t �|� nt � � }t � |�}|� |� t j�||�}t �|� t j�|��s=|
j!|t j�d|� �|�d� q�tjjj"|d
d�D ];\}}}|D ]2}|�#d��rW�qM|�$d��rit j�||�|v�ri�qM|
j!t j�||�t j�d|� �||�d� �qM�qF|du�r�t%�&|� d}q�q�t �|� |
�!d� tjj�|d��} | � tj
j� W d � n 1 �s�w Y tjj�|d��} | � ttjd �� W d � n 1 �s�w Y t �t j�|�� |
�!d� |
�!d� |�r�t �|� |
�'� |S )a�
Generate the salt-min tarball and print the location of the tarball
Optional additional mods to include (e.g. mako) can be supplied as a comma
delimited string. Permits forcing an overwrite of the output file as well.
CLI Example:
.. code-block:: bash
salt-run min.generate
salt-run min.generate mako
salt-run min.generate mako,wempy 1
salt-run min.generate overwrite=1
�minzmin.tgzr� z.min-gen-py-versionr� r� NFr Tr� �3r� r� )xzsalt/__init__.pyz
salt/utilszsalt/utils/__init__.pyzsalt/utils/atomicfile.pyzsalt/utils/validatez salt/utils/validate/__init__.pyzsalt/utils/validate/path.pyzsalt/utils/decoratorsz!salt/utils/decorators/__init__.pyzsalt/utils/cache.pyzsalt/utils/xdg.pyzsalt/utils/odict.pyzsalt/utils/minions.pyzsalt/utils/dicttrim.pyzsalt/utils/sdb.pyzsalt/utils/migrations.pyzsalt/utils/files.pyzsalt/utils/parsers.pyzsalt/utils/locales.pyzsalt/utils/lazy.pyzsalt/utils/s3.pyzsalt/utils/dictupdate.pyzsalt/utils/verify.pyzsalt/utils/args.pyzsalt/utils/kinds.pyzsalt/utils/xmlutil.pyzsalt/utils/debug.pyzsalt/utils/jid.pyzsalt/utils/openstackz salt/utils/openstack/__init__.pyz salt/utils/openstack/swift.pyzsalt/utils/asynchronous.pyzsalt/utils/process.pyzsalt/utils/jinja.pyzsalt/utils/rsax931.pyzsalt/utils/context.pyzsalt/utils/minion.pyzsalt/utils/error.pyzsalt/utils/aws.pyz salt/utils/timed_subprocess.pyzsalt/utils/zeromq.pyzsalt/utils/schedule.pyzsalt/utils/url.pyzsalt/utils/yamlencoding.pyzsalt/utils/network.pyzsalt/utils/http.pyzsalt/utils/gzip_util.pyzsalt/utils/vt.pyzsalt/utils/templates.pyzsalt/utils/aggregation.pyzsalt/utils/yaml.pyzsalt/utils/yamldumper.pyzsalt/utils/yamlloader.pyzsalt/utils/event.pyzsalt/utils/state.pyzsalt/serializersz salt/serializers/__init__.pyzsalt/serializers/yamlex.pyzsalt/template.pyzsalt/_compat.pyzsalt/loader.pyz salt/clientzsalt/client/__init__.pyzsalt/extzsalt/ext/__init__.pyzsalt/ext/ipaddress.pyzsalt/version.pyzsalt/syspaths.pyz
salt/defaultszsalt/defaults/__init__.pyzsalt/defaults/exitcodes.pyzsalt/rendererszsalt/renderers/__init__.pyzsalt/renderers/jinja.pyzsalt/renderers/yaml.pyz salt/moduleszsalt/modules/__init__.pyzsalt/modules/test.pyzsalt/modules/selinux.pyzsalt/modules/cmdmod.pyzsalt/modules/saltutil.pyzsalt/minion.pyz salt/pillarzsalt/pillar/__init__.pyzsalt/utils/textformat.pyzsalt/log_handlersz salt/log_handlers/__init__.pyzsalt/_logging/__init__.pyzsalt/_logging/handlers.pyzsalt/_logging/impl.pyzsalt/_logging/mixins.pyzsalt/clizsalt/cli/__init__.pyzsalt/cli/caller.pyzsalt/cli/daemons.pyzsalt/cli/salt.pyzsalt/cli/call.pyzsalt/fileserverzsalt/fileserver/__init__.pyz salt/channelzsalt/channel/__init__.pyzsalt/channel/client.pyzsalt/transportzsalt/transport/__init__.pyzsalt/transport/client.pyzsalt/exceptions.pyz salt/grainszsalt/grains/__init__.pyzsalt/grains/extra.pyzsalt/scripts.pyz
salt/state.pyzsalt/fileclient.pyz
salt/crypt.pyzsalt/config.pyz salt/beaconszsalt/beacons/__init__.pyzsalt/payload.pyz salt/outputzsalt/output/__init__.pyzsalt/output/nested.pyrR r� r� r� r r� )(r r r r� r� r r! rc r� r� r) rw r� r� r� r� r r� r� r
r@ r� r� r� rn r0 r8 r� r� r� r� r� r� r� r� rv �
startswithr� r� r� )r+ r� r� r� Zmindir�mintarZminverZpyminverr� r� r� r� rB r� r� r� Z min_filesr` r� r� r� r� r� r& rc r r r r �gen_min
s�
� � �� � �{
�
��
��
!
� �
r c C s t | �}tjj�||�S )r� )r r r! r� r� )r+ r� r r r r �min_sum� s r )NN)rj rj )rj Frj Tr� N)r� )rj Frj )D�__doc__r� r� rl �importlib.utilr �loggingr r� r rW r r� r� r� rO r- rK r. rL rD r Zsalt.exceptionsZsalt.ext.tornado�extrE Zsalt.utils.filesZsalt.utils.hashutilsZsalt.utils.jsonZsalt.utils.pathZsalt.utils.stringutilsZ salt.versionr� r� r� r� r/ rF rH rJ Zsalt.ext.backports_abcrI Z backportsr Zsalt.extrG � getLoggerr� r r r r r) r, r2 r; rC rg r� r� r@ r� r� r� r� r� r r r r r r �<module> s� � � � � � � ����
-
?C
AF
�
5
� i