3 3P7 @sdZddlmZddlmZdejejejejej ej e e e edf ddZd d Zdd d ZeZydd lmZWnek rdZYn XejZeZdS)a, tinycss.tokenizer ----------------- Tokenizer for the CSS core syntax: http://www.w3.org/TR/CSS21/syndata.html#tokenization This is the pure-python implementation. See also speedups.pyx :copyright: (c) 2012 by Simon Sapin. :license: BSD, see LICENSE for more details. )unicode_literals) token_dataTNc Csd} d}d}||}g}x|| |kr|| }|dkr@|}|}nFtt|d}x6||D]"\}}}||| }|rX|j}PqXWd}|}||}| |}|o|dksT| }|dkr|jd}d |kr| |n| |}|jd }||}||}|j}nD|d kr0|d d}d |kr | |n| |}d }n |dkr`|}d |krR| |}n | |}d}n|dkr|||}||}n|dkr|jd}|r|ddkr|dd}||}||}||}nr|dkr|dd}||}||}||}nB|dkr8||kr8d}|dd }||}||}||}n|}|j||||||||} | ||}|r|||7}||djd}q||7}qW|S)z :param css_source: CSS as an unicode string :param ignore_comments: if true (the default) comments will not be included in the return value :return: An iterator of :class:`Token` rrz:;{}()[]ZDELIMCOMMENT BAD_COMMENTZ DIMENSION.Z PERCENTAGEN%NUMBERZINTEGERIDENT ATKEYWORDHASHFUNCTIONURIz"'STRINGZ BAD_STRING)rr)r r rrrrr)minordgrouplowerappendend) css_sourceignore_commentsZtokens_dispatchZunicode_unescapeZnewline_unescapeZsimple_unescapeZ find_newlinesTokenlenintfloatlistZ_NoneposlinecolumnZ source_lentokenschartype_Z css_valueZ codepoint_indexZregexpmatchlengthZnext_posZunitvaluenewlinesr+Q/var/www/html/enquirykeeper_venv/lib/python3.6/site-packages/tinycss/tokenizer.py tokenize_flats                       r-cs@ddddd}t|}dg}d|||tjtjffdd S) a Match pairs of tokens: () [] {} function() (Strings in "" or '' are taken care of by the tokenizer.) Opening tokens are replaced by a :class:`ContainerToken`. Closing tokens are removed. Unmatched closing tokens are invalid but left as-is. All nested structures that are still open at the end of the stylesheet are implicitly closed. :param tokens: a *flat* iterable of tokens, as returned by :func:`tokenize_flat`. :return: A tree of tokens. )]})r([{FNc 3sx|D]}|j}||krdS|j|}|dkr6|Vqt|| sPtdj|t|} |drhd}|dkr||j|j||j| |j|j Vq||j|j|| |j|j VqWd|d<dS)Nz Token looks already grouped: {0}rrT) typeget isinstanceAssertionErrorformatrZas_cssr)r!r") Zstop_atr#pairseofContainerToken FunctionTokentokenr%rcontent)_regroup_innerr+r,r@s(    zregroup.._regroup_inner)iterrr<r=)r#r:r;r+)r@r,regroupsrBcCstt||S)z :param css_source: CSS as an unicode string :param ignore_comments: if true (the default) comments will not be included in the return value :return: An iterator of :class:`Token` )rBr-)rrr+r+r,tokenize_groupeds rC)speedups)T)__doc__ __future__rr4rZTOKEN_DISPATCHZUNICODE_UNESCAPEZNEWLINE_UNESCAPEZSIMPLE_UNESCAPEZ FIND_NEWLINESrrrrrr-rBrCZpython_tokenize_flatrD ImportErrorZcython_tokenize_flatr+r+r+r, s.   l4