File: //lib/python3.6/site-packages/jmespath/__pycache__/parser.cpython-36.pyc
3
g� V`M � @ sp d Z ddlZddlmZ ddlmZ ddlmZ ddlmZ ddlmZ G dd � d e �Z
eG d
d � d e ��Z dS ) a� Top down operator precedence parser.
This is an implementation of Vaughan R. Pratt's
"Top Down Operator Precedence" parser.
(http://dl.acm.org/citation.cfm?doid=512927.512931).
These are some additional resources that help explain the
general idea behind a Pratt parser:
* http://effbot.org/zone/simple-top-down-parsing.htm
* http://javascript.crockford.com/tdop/tdop.html
A few notes on the implementation.
* All the nud/led tokens are on the Parser class itself, and are dispatched
using getattr(). This keeps all the parsing logic contained to a single
class.
* We use two passes through the data. One to create a list of token,
then one pass through the tokens to create the AST. While the lexer actually
yields tokens, we convert it to a list so we can easily implement two tokens
of lookahead. A previous implementation used a fixed circular buffer, but it
was significantly slower. Also, the average jmespath expression typically
does not have a large amount of token so this is not an issue. And
interestingly enough, creating a token list first is actually faster than
consuming from the token iterator one token at a time.
� N)�lexer)�with_repr_method)�ast)�
exceptions)�visitorc @ s� e Zd Zdddddddddddddddddddddddd d
d d d
d� ZdZi ZdZdxdd�Zdd� Zdd� Z dd� Z
dydd�Z dd � Z d d � Z
d d � Zd!d"� Zd#d$� Zd%d&� Zd'd(� Zd)d*� Zd+d,� Zd-d.� Zd/d0� Zd1d2� Zd3d4� Zd5d6� Zd7d8� Zd9d:� Zd;d<� Z d=d>� Z d?d@� Z dAdB� Z dCdD� Z dEdF� Z!dGdH� Z"dIdJ� Z#dKdL� Z$dMdN� Z%dOdP� Z&dQdR� Z'dSdT� Z(dUdV� Z)dWdX� Z*dYdZ� Z+d[d\� Z,d]d^� Z-d_d`� Z.dadb� Z/dcdd� Z0dedf� Z1dzdhdi�Z2djdk� Z3dldm� Z4dndo� Z5dpdq� Z6drds� Z7dtdu� Z8e9dvdw� �Z:dgS ){�Parserr � � � � � � � �( �- �2 �7 �< ) �eof�unquoted_identifier�quoted_identifier�rbracket�rparen�comma�rbrace�numberZcurrent�expref�colon�pipe�or�and�eq�gt�lt�gte�lte�ne�flatten�star�filter�dot�not�lbrace�lbracket�lparen�
� c C s" d | _ d g| | _|| _d| _d S )Nr )� tokenizer�_tokensZ _buffer_size�_index)�self� lookahead� r6 � /usr/lib/python3.6/parser.py�__init__M s zParser.__init__c C sH | j j|�}|d k r|S | j|�}|| j |< t| j �| jkrD| j� |S )N)�_CACHE�get� _do_parse�len� _MAX_SIZE�_free_cache_entries)r4 �
expression�cachedZ
parsed_resultr6 r6 r7 �parseS s
z Parser.parsec C s� y
| j |�S tjk
r6 } z||_� W Y d d }~X nZ tjk
rd } z|j|� � W Y d d }~X n, tjk
r� } z||_� W Y d d }~X nX d S )N)�_parser Z
LexerErrorr? �IncompleteExpressionErrorZset_expression�
ParseError)r4 r? �er6 r6 r7 r; ] s
zParser._do_parsec C sr t j� j|�| _t| j�| _d| _| jdd�}| j� dksh| j d�}t
j |d |d |d d|d ��t ||�S )Nr )�
binding_powerr �start�value�typezUnexpected token: %s)
r ZLexer�tokenizer1 �listr2 r3 � _expression�_current_token�_lookahead_tokenr rD � ParsedResult)r4 r? �parsed�tr6 r6 r7 rB j s
z
Parser._parsec C s� | j d�}| j� t| d|d | j�}||�}| j� }xX|| j| k r�t| d| d �}|d krv| j d�}| j|� q:| j� ||�}| j� }q:W |S )Nr z
_token_nud_%srI z
_token_led_%s)rN �_advance�getattr�_error_nud_tokenrM �
BINDING_POWER�_error_led_token)r4 rF Z
left_tokenZ nud_function�left�
current_tokenZledZ error_tokenr6 r6 r7 rL u s
zParser._expressionc C s t j|d �S )NrH )r �literal)r4 �tokenr6 r6 r7 �_token_nud_string_literal� s z Parser._token_nud_string_literalc C s t j|d �S )NrH )r rY )r4 rZ r6 r6 r7 �_token_nud_literal� s zParser._token_nud_literalc C s t j|d �S )NrH )r �field)r4 rZ r6 r6 r7 � _token_nud_unquoted_identifier� s z%Parser._token_nud_unquoted_identifierc C s@ t j|d �}| j� dkr<| jd�}tjd|d |d d��|S )NrH r. r rI z1Quoted identifier not allowed for function names.)r r] rM rN r rD )r4 rZ r] rQ r6 r6 r7 � _token_nud_quoted_identifier� s
z#Parser._token_nud_quoted_identifierc C s: t j� }| j� dkr t j� }n| j| jd �}t j||�S )Nr r( )r �identityrM �_parse_projection_rhsrU �value_projection)r4 rZ rW �rightr6 r6 r7 �_token_nud_star� s
zParser._token_nud_starc C s | j tj� �S )N)�_token_led_filterr r` )r4 rZ r6 r6 r7 �_token_nud_filter� s zParser._token_nud_filterc C s | j � S )N)�_parse_multi_select_hash)r4 rZ r6 r6 r7 �_token_nud_lbrace� s zParser._token_nud_lbracec C s | j � }| jd� |S )Nr )rL �_match)r4 rZ r? r6 r6 r7 �_token_nud_lparen� s
zParser._token_nud_lparenc C s* t jt j� �}| j| jd �}t j||�S )Nr' )r r' r` ra rU �
projection)r4 rZ rW rc r6 r6 r7 �_token_nud_flatten� s zParser._token_nud_flattenc C s | j | jd �}tj|�S )Nr+ )rL rU r Znot_expression)r4 rZ �exprr6 r6 r7 �_token_nud_not� s zParser._token_nud_notc C sz | j � dkr$| j� }| jtj� |�S | j � dkrn| jd�dkrn| j� | j� | j| jd �}tj tj� |�S | j
� S d S )Nr r r( r r )r r ) rM �_parse_index_expression�_project_if_slicer r` �
_lookaheadrR ra rU rk �_parse_multi_select_list)r4 rZ rc r6 r6 r7 �_token_nud_lbracket� s zParser._token_nud_lbracketc C sR | j d�dks | j d�dkr$| j� S tj| jd�d �}| j� | jd� |S d S )Nr r r rH r )rq �_parse_slice_expressionr �indexrN rR ri )r4 �noder6 r6 r7 ro � s
z Parser._parse_index_expressionc C s� d d d g}d}| j � }x�|dk r�|dk r�|dkrD|d7 }| j� nV|dkrh| jd�d ||< | j� n2| jd�}|d }|d }|d }tj|||d
��| j � }qW | jd� tj|� S ) Nr r r
r r r rH rG rI z syntax error)rM rR rN r rD ri r �slice)r4 �partsru rX rQ � lex_position� actual_value� actual_typer6 r6 r7 rt � s&
z Parser._parse_slice_expressionc C s t j� S )N)r Z current_node)r4 rZ r6 r6 r7 �_token_nud_current� s zParser._token_nud_currentc C s | j | jd �}tj|�S )Nr )rL rU r r )r4 rZ r? r6 r6 r7 �_token_nud_expref� s zParser._token_nud_exprefc C sr | j � dksJ| j| jd �}|d dkr:|d j|� |S tj||g�S n$| j� | j| jd �}tj||�S d S )Nr( r* rI �
subexpression�children) rM �_parse_dot_rhsrU �appendr r~ rR ra rb )r4 rW rc r6 r6 r7 �_token_led_dot� s zParser._token_led_dotc C s | j | jd �}tj||�S )Nr )rL rU r r )r4 rW rc r6 r6 r7 �_token_led_pipe s zParser._token_led_pipec C s | j | jd �}tj||�S )Nr )rL rU r Z
or_expression)r4 rW rc r6 r6 r7 �
_token_led_or s zParser._token_led_orc C s | j | jd �}tj||�S )Nr )rL rU r Zand_expression)r4 rW rc r6 r6 r7 �_token_led_and s zParser._token_led_andc C s` |d }g }x8| j � dksD| j� }| j � dkr8| jd� |j|� qW | jd� tj||�}|S )NrH r r )rM rL ri r� r Zfunction_expression)r4 rW �name�argsr? Z
function_noder6 r6 r7 �_token_led_lparen s
zParser._token_led_lparenc C sH | j d�}| jd� | j� dkr*tj� }n| j| jd �}tj|||�S )Nr r r' r) )rL ri rM r r` ra rU Zfilter_projection)r4 rW Z conditionrc r6 r6 r7 re s
zParser._token_led_filterc C s | j |d�S )Nr! )�_parse_comparator)r4 rW r6 r6 r7 �
_token_led_eq* s zParser._token_led_eqc C s | j |d�S )Nr& )r� )r4 rW r6 r6 r7 �
_token_led_ne- s zParser._token_led_nec C s | j |d�S )Nr" )r� )r4 rW r6 r6 r7 �
_token_led_gt0 s zParser._token_led_gtc C s | j |d�S )Nr$ )r� )r4 rW r6 r6 r7 �_token_led_gte3 s zParser._token_led_gtec C s | j |d�S )Nr# )r� )r4 rW r6 r6 r7 �
_token_led_lt6 s zParser._token_led_ltc C s | j |d�S )Nr% )r� )r4 rW r6 r6 r7 �_token_led_lte9 s zParser._token_led_ltec C s& t j|�}| j| jd �}t j||�S )Nr' )r r' ra rU rk )r4 rW rc r6 r6 r7 �_token_led_flatten< s
zParser._token_led_flattenc C s~ | j d�}|d d krJ| j� }|d dkr<|d j|� |S | j||�S n0| jd� | jd� | j| jd �}tj||�S d S )
Nr rI r r �index_expressionr r( r )r r ) rN ro r� rp ri ra rU r rk )r4 rW rZ rc r6 r6 r7 �_token_led_lbracketB s
zParser._token_led_lbracketc C s: t j||g�}|d dkr2t j|| j| jd ��S |S d S )NrI rw r( )r r� rk ra rU )r4 rW rc Z
index_exprr6 r6 r7 rp U s zParser._project_if_slicec C s | j | j| �}tj|||�S )N)rL rU r �
comparator)r4 rW r� rc r6 r6 r7 r� ^ s zParser._parse_comparatorc C sJ g }x0| j � }|j|� | j� dkr(P q| jd� qW | jd� tj|�S )Nr r )rL r� rM ri r Zmulti_select_list)r4 Z expressionsr? r6 r6 r7 rr b s
z Parser._parse_multi_select_listc C s� g }x�| j d�}| jddgd� |d }| jd� | jd�}tj||d�}|j|� | j� dkrl| jd� q| j� d kr| jd � P qW tj|d
�S ) Nr r r )� token_typesrH r )�key_namerv r r )Znodes) rN �_match_multiple_tokensri rL r Z key_val_pairr� rM Zmulti_select_dict)r4 ZpairsZ key_tokenr� rH rv r6 r6 r7 rg n s
z Parser._parse_multi_select_hashc C s� | j | j� | jk r tj� }n�| j� dkr6| j|�}nl| j� dkrN| j|�}nT| j� dkrp| jd� | j|�}n2| jd�}|d }|d }|d }t j
|||d��|S ) Nr- r) r* r rG rH rI z syntax error) rU rM �_PROJECTION_STOPr r` rL ri r� rN r rD )r4 rF rc rQ ry rz r{ r6 r6 r7 ra � s
z Parser._parse_projection_rhsc C s� | j � }|d kr| j|�S |dkr4| jd� | j� S |dkrN| jd� | j� S | jd�}ddddg}|d }|d }|d }tj|||d
||f ��d S ) Nr r r( r- r, r rG rH rI zExpecting: %s, got: %s)r r r( )rM rL ri rr rg rN r rD )r4 rF r5 rQ Zallowedry rz r{ r6 r6 r7 r� � s&
zParser._parse_dot_rhsc G sJ | j � |krF| jd�}|d }|d }|d }tj|||d||f ��d S )Nr rG rH rI z Token %s not allowed to be: %s)rM rN r rD )r4 r� rQ ry rz r{ r6 r6 r7 �_assert_not_token� s
zParser._assert_not_tokenc C sF |d dkr&t j|d |d |d ��t j|d |d |d d��d S )NrI r rG rH zInvalid token.)r rC rD )r4 rZ r6 r6 r7 rT � s
zParser._error_nud_tokenc C s t j|d |d |d d��d S )NrG rH rI z
Invalid token)r rD )r4 rZ r6 r6 r7 rV � s zParser._error_led_tokenNc C sp | j � |kr| j� nV| jd�}|d }|d }|d }|dkrPtj|||��n d||f }tj||||��d S )Nr rG rH rI r zExpecting: %s, got: %s)rM rR rN r rC rD )r4 �
token_typerQ ry rz r{ �messager6 r6 r7 ri � s
z
Parser._matchc C sn | j � |krb| jd�}|d }|d }|d }|dkrFtj|||��n d||f }tj||||��| j� d S )Nr rG rH rI r zExpecting: %s, got: %s)rM rN r rC rD rR )r4 r� rQ ry rz r{ r� r6 r6 r7 r� � s
z Parser._match_multiple_tokensc C s | j d7 _ d S )Nr )r3 )r4 r6 r6 r7 rR � s zParser._advancec C s | j | j d S )NrI )r2 r3 )r4 r6 r6 r7 rM � s zParser._current_tokenc C s | j | j| d S )NrI )r2 r3 )r4 r r6 r6 r7 rq � s zParser._lookaheadc C s | j | j| S )N)r2 r3 )r4 r r6 r6 r7 rN � s zParser._lookahead_tokenc C s2 x,t j| jj� t| jd ��D ] }| j|= q W d S )Nr )�randomZsampler9 �keys�intr= )r4 �keyr6 r6 r7 r> � s "zParser._free_cache_entriesc C s | j j� dS )z'Clear the expression compilation cache.N)r9 �clear)�clsr6 r6 r7 �purge� s z Parser.purge)r )r )N);�__name__�
__module__� __qualname__rU r� r9 r= r8 rA r; rB rL r[ r\ r^ r_ rd rf rh rj rl rn rs ro rt r| r} r� r� r� r� r� re r� r� r� r� r� r� r� r� rp r� rr rg ra r� r� rT rV ri r� rR rM rq rN r> � classmethodr� r6 r6 r6 r7 r % s�
r c @ s. e Zd Zdd� Zd
dd�Zdd� Zdd � ZdS ) rO c C s || _ || _d S )N)r? rP )r4 r? rP r6 r6 r7 r8 s zParsedResult.__init__Nc C s t j|�}|j| j|�}|S )N)r ZTreeInterpreter�visitrP )r4 rH ZoptionsZ interpreter�resultr6 r6 r7 �search
s
zParsedResult.searchc C s t j� }|j| j�}|S )af Render the parsed AST as a dot file.
Note that this is marked as an internal method because
the AST is an implementation detail and is subject
to change. This method can be used to help troubleshoot
or for development purposes, but is not considered part
of the public supported API. Use at your own risk.
)r ZGraphvizVisitorr� rP )r4 Zrenderer�contentsr6 r6 r7 �_render_dot_file s
z ParsedResult._render_dot_filec C s
t | j�S )N)�reprrP )r4 r6 r6 r7 �__repr__ s zParsedResult.__repr__)N)r� r� r� r8 r� r� r� r6 r6 r6 r7 rO s
rO ) �__doc__r� Zjmespathr Zjmespath.compatr r r r �objectr rO r6 r6 r6 r7 �<module> s b