File: //opt/saltstack/salt/lib/python3.10/site-packages/salt/fileserver/__pycache__/roots.cpython-310.pyc
o
�N�gnD � @ s� d Z ddlZddlZddlZddlZddlZddlZddlZddl Zddl
Zddl Zddl Zddl
ZddlZe�e�Zddd�Zdd� Zdd � Zd
d � Zd d
� Zdd� Zdd� Zdd� Zdd� Zdd� ZdS )a�
The default file server backend
This fileserver backend serves files from the Master's local filesystem. If
:conf_master:`fileserver_backend` is not defined in the Master config file,
then this backend is enabled by default. If it *is* defined then ``roots`` must
be in the :conf_master:`fileserver_backend` list to enable this backend.
.. code-block:: yaml
fileserver_backend:
- roots
Fileserver environments are defined using the :conf_master:`file_roots`
configuration option.
� N�basec K s� |}d|v r |� d� tj�| �} ddd�}tj�| �r |S |td vr5dtd v r3t�d|� d}n|S dd� }d |v r�ztd | t|d � }W n t yV | Y S t
y` | Y S w tj� || �}tj� |�r�t
j�t|�s�||d
< | |d < ||�S |S td | D ]=}|dkr�|�d|�}tj� || �}t
jjj||d td
d�s�q�tj� |�r�t
j�t|�s�||d
< | |d < ||� S q�|S )z7
Search the environment for the relative path.
�env� )�path�rel�
file_roots�__env__�:salt environment '%s' maps to __env__ file_roots directoryc
S sP zt t�| d ��| d< W | S ty' } z
t�d|� W Y d}~| S d}~ww )a0
Stat the file and, assuming no errors were found, convert the stat
result to a list of values and add to the return dict.
Converting the stat result to a list, the elements of the list
correspond to the following stat_result params:
0 => st_mode=33188
1 => st_ino=10227377
2 => st_dev=65026
3 => st_nlink=1
4 => st_uid=1000
5 => st_gid=1000
6 => st_size=1056233
7 => st_atime=1468284229
8 => st_mtime=1456338235
9 => st_ctime=1456338235
r �statzUnable to stat file: %sN)�list�osr
� Exception�log�error)�fnd�exc� r �I/opt/saltstack/salt/lib/python3.10/site-packages/salt/fileserver/roots.py�_add_file_stat: s ���z!find_file.<locals>._add_file_stat�indexr r T�fileserver_followsymlinks�Zsubdir�realpath)�popr r �normpath�isabs�__opts__r �debug�int�
IndexError�
ValueError�join�isfile�salt�
fileserver�is_file_ignored�replace�utils�verify�
clean_path)r �saltenv�kwargs�actual_saltenvr r �root�fullr r r � find_file$ sV
� � � �r/ c C s t td �S )z-
Return the file server environments
r )�sortedr r r r r �envst s r1 c C sr d| v r | � d� ddd�}d| vsd| vsd| vr |S |d s"|S |d |d< | �d d
�}tj�|d �}| d }}|td vrSd td v rQt�d
|� d }n|S d}td | D ] }|d krg|�d |�}t j
j j ||dtd d�rwd}q[|s||S t j
j
�|d��+} | �| d � | �td �}
|r�|
r�t j
j�|
|�}
||d < |
|d< W d
� |S 1 s�w Y |S )z?
Return a chunk from a file based on the data received
r r )�data�destr �locr* r r3 �gzipNr r r FTr r �rbZfile_buffer_sizer2 )r �getr r r r r r r& r# r' r( r) �files�fopen�seek�readZ gzip_util�compress) �loadr �retr5 Zfpathr, r* Z file_in_rootr- �fp_r2 r r r �
serve_file{ sP
� ��
��r@ c
C sn zt j�tj�td dd�t� W n ty Y nw tj�td dd�} ddg idd�}t j� ttd �}i }zUt j
j j | d d
��B}|D ]7}z%|�
� �d d �\}}t|�}|||< ||�||�krk|d
d �|� W qE ty| t�d| |� Y qEw W d � n1 s�w Y W n ttfy� Y nw t j�||�|d< t|�}t|�} t|| �|d
d< t| | �|d
d< tj�| �}
tj�|
�s�t�|
� t j
j � | d��!}|� � D ]\}}|� t j
j � |� d |� d��� q�W d � n1 s�w Y t�dd��r5t j
j j!dtd tdd��} | �"|t j
j j#ddgdd�� W d � |S 1 �s0w Y |S )zL
When we are asked to update (regular interval) lets reap the cache
�cachedir�roots�hashZ mtime_mapF�changed)rD r8 Zbackendr �utf-8��encoding�:� r8 z+Skipped invalid cache mtime entry in %s: %sNZremovedZadded�wb�
Zfileserver_eventsZmasterZsock_dir)�opts�listen�updater$ ��prefix)$r# r$ Zreap_fileserver_cache_dirr r r! r r/ �OSErrorZgenerate_mtime_mapr' r8 r9 �strip�rsplit�floatr7 �appendr r �warning�UnicodeDecodeErrorZdiff_mtime_map�setr �dirname�exists�makedirs�items�writeZ stringutils�to_bytes�eventZ get_eventZ
fire_eventZtagify) Zmtime_map_pathr2 Z
new_mtime_mapZ
old_mtime_mapr? �lineZ file_path�mtimeZ old_filesZ new_filesZmtime_map_path_dirr_ r r r rN � s| � �� ��� ���
"� ���
� � rN c C s� d| v r | � d� d| vsd| vrdS |d }| d }|td vr)dtd v r)d}i }|r3tj�|�s5|S td |d< tj�td d d
|d �|d td ��}tj�|�r�zktj j
j |d
d��X}z |� � �
d�\}}W n, ty� t�d� zt�|� W n ty� Y nw t| |� Y W d � W S w ttj�|��|kr�||d< |W d � W S W d � n1 s�w Y W n$ ty� t�d� zt�|� W n ty� Y nw t| |� Y S w tj j�|td �|d< tj�|�} tj�| ��s"zt�| � W n t�y! }
z|
jtjk�rn� W Y d}
~
nd}
~
ww d�|d tj�|��} tj j
� |d��}|� | � W d � |S 1 �sHw Y |S )zL
Return a file hash, the hash type is set in the master config file
r r r* r r r Z hash_typerA rB rC z
{}.hash.{}r rE rF rH z=Fileserver attempted to read incomplete cache file. Retrying.N�hsumz>Fileserver encountered lock when reading cache file. Retrying.z{}:{}�w) r r r r r" r! �formatrZ r# r' r8 r9 r; �splitr r r �unlinkrQ � file_hash�str�getmtimeZ hashutilsZget_hashrY r[ �errnoZEEXISTZflopenr] ) r= r r r* r> �
cache_pathr? rb ra Z cache_dir�errZ cache_objectr r r rg � s�
� � � �
�
��
��
���
��rg c s� d| v r | � d� | d }|}|td vr&dtd v r$t�d|� d}ng S tj�td dd�}tj�|�sOzt�|� W n t yN t�
d |� g Y S w tj�|t j j
�|�� d
��}tj�|d t j j
�|�� d ��}t j�t|||�\}}} |d
ur�|S |r�t� t� t� i d�� � fdd�}
td | D ]/} |dkr�| �d|�} t j jj| td d�D ]\} }
}|
� d | | |
� |
� d | | |� q�q�t� d �� d< t� d �� d< t� d �� d< | r�z t j�t� ||� W n ty� Y nw � �|g �S g S )zZ
Return a dict containing the file lists for files, dirs, empty dirs and symlinks
r r* r r r rA Z
file_listsrB zUnable to make cachedir %sz.p�.z.wN)r8 �dirs�
empty_dirs�linksc s� dd� }|D ]�}t j�||�}t�d|� tjj�|�}t�d||s$dnd� |r.td r.q|t j� ||��}t�d||� tj
� t|�rFq| � |� t j�
|�rozt �|�s^� d � |� W n tyn t�d
|� Y nw |r�tjj�|�} t�d || � tjj�� r�| �d �r�t�d
| |� |} | �d�r�t j�|| �}
n t j�t j�|�| �}
|t j� t j�t j�|
��t j�|���} t�d|| � | �d�s�| � d |< qtd s�| � d |< qdS )z9
Add the files to the target set
c S s t jjdkr | �dd�S | S )zZ
Translate path separators for Windows masterless minions
�\�/)r r �sepr& )r r r r �_translate_sepu s z4_file_lists.<locals>._add_to.<locals>._translate_sepzroots: Processing %szroots: %s is %sa linkznot r Zfileserver_ignoresymlinksz roots: %s relative path is %sro zUnable to list dir: %sz#roots: %s symlink destination is %sz\\z)roots: %s is a UNC path, using %s insteadz..rp r N)r r r! r Ztracer# r' �islinkr �relpathr$ r% �add�isdir�listdirrQ r �readlink�platformZ
is_windows�
startswithrY r r ) ZtgtZfs_rootZ
parent_dirr\ rt �itemZabs_path�is_linkZrel_pathZ link_destZjoinedZrel_dest�r> r r �_add_top sj �
� ����
��
��z _file_lists.<locals>._add_tor )� followlinksrn r8 ro )r r r r r r r! rx r[ rQ �criticalr# r' r8 Zsafe_filename_leafr$ Zcheck_file_list_cacherX r& Zos_walkr0 Zwrite_file_list_cache� NameErrorr7 )r= Zformr* r, Z
list_cachedirZ
list_cacheZw_lockZ cache_matchZ
refresh_cacheZ
save_cacher� r r- rn r8 r r r � _file_listsF sn
� ���
� D �� � r� c C �
t | d�S )zV
Return a list of all files on the file server in a specified
environment
r8 �r� �r= r r r � file_list� s
r� c C r� )z>
Return a list of all empty directories on the master
ro r� r� r r r �file_list_emptydirs� �
r� c C r� )z8
Return a list of all directories on the master
rn r� r� r r r �dir_list� r� r� c sr d| v r | � d� i }| d td vrdtd vr|S d| v r'| d �d�� nd� t| d�}� fd d
�|�� D �S ) zK
Return a dict of all symlinks based on a given path on the Master
r r* r r rP rr r rp c s i | ] \}}|� � �r||�qS r )r| )�.0�key�valrO r r �
<dictcomp>� s z symlink_list.<locals>.<dictcomp>)r r rR r� r\ )r= r> �symlinksr rO r � symlink_list� s
r� )r ) �__doc__rj �loggingr Zsalt.fileserverr# Zsalt.utils.eventZsalt.utils.filesZsalt.utils.gzip_utilZsalt.utils.hashutilsZsalt.utils.pathZsalt.utils.platformZsalt.utils.stringutilsZsalt.utils.verifyZsalt.utils.versions� getLogger�__name__r r/ r1 r@ rN rg r� r� r� r� r� r r r r �<module> s4
P0IR