3 3P2 @sZdZddlmZddlZddlZddlZddlZddlZdjddjddZ d Z iZ gZ iZ gZyeWnek reZeZYnXd d Zeeeejfd d Zejeje dejjeZejejde djdZejejde dejjejddZeje dj Z!Gddde"Z#Gddde"Z$Gddde$Z%Gddde&Z'dS)z tinycss.token_data ------------------ Shared data for both implementations (Cython and Python) of the tokenizer. :copyright: (c) 2012 by Simon Sapin. :license: BSD, see LICENSE for more details. )unicode_literalsNa nl \n|\r\n|\r|\f w [ \t\r\n\f]* nonascii [^\0-\237] unicode \\([0-9a-f]{{1,6}})(\r\n|[ \n\r\t\f])? simple_escape [^\n\r\f0-9a-f] escape {unicode}|\\{simple_escape} nmstart [_a-z]|{nonascii}|{escape} nmchar [_a-z0-9-]|{nonascii}|{escape} name {nmchar}+ ident [-]?{nmstart}{nmchar}* num [-+]?(?:[0-9]*\.[0-9]+|[0-9]+) string1 \"([^\n\r\f\\"]|\\{nl}|{escape})*\" string2 \'([^\n\r\f\\']|\\{nl}|{escape})*\' string {string1}|{string2} badstring1 \"([^\n\r\f\\"]|\\{nl}|{escape})*\\? badstring2 \'([^\n\r\f\\']|\\{nl}|{escape})*\\? badstring {badstring1}|{badstring2} badcomment1 \/\*[^*]*\*+([^/*][^*]*\*+)* badcomment2 \/\*[^*]*(\*+[^/*][^*]*)* badcomment {badcomment1}|{badcomment2} baduri1 url\({w}([!#$%&*-~]|{nonascii}|{escape})*{w} baduri2 url\({w}{string}{w} baduri3 url\({w}{badstring} baduri {baduri1}|{baduri2}|{baduri3} z\0z\237Ÿa S [ \t\r\n\f]+ URI url\({w}({string}|([!#$%&*-\[\]-~]|{nonascii}|{escape})*){w}\) BAD_URI {baduri} FUNCTION {ident}\( UNICODE-RANGE u\+[0-9a-f?]{{1,6}}(-[0-9a-f]{{1,6}})? IDENT {ident} ATKEYWORD @{ident} HASH #{name} DIMENSION ({num})({ident}) PERCENTAGE {num}% NUMBER {num} STRING {string} BAD_STRING {badstring} COMMENT \/\*[^*]*\*+([^/*][^*]*\*+)*\/ BAD_COMMENT {badcomment} : : ; ; { \{{ } \}} ( \( ) \) [ \[ ] \] CDO c Cs~tjx>tjD]2}|jr|jd\}}d|jftt|j<qWddtjDtdd<t jx t tD]\}\}}|t |<qtWddt dD}xd d gfd d d dgft j dtdddgft jddddgfddgfddgfdddgfddd gfd!d"gfd#d$gfg D],\}}x |D]}|t|j|q$WqWxd%D]}|g|t|<qLWd&d|Dtdd<dS)'zImport-time initialization. z(?:%s)cssL|]D}|jr|jdgD]*\}}|jtj|jfttjjfVqqdS)rN)stripsplitrecompileformatCOMPILED_MACROSImatch).0linenamevaluerR/var/www/html/enquirykeeper_venv/lib/python3.6/site-packages/tinycss/token_data.py s z_init..NcSsg|]}gqSrr)rirrr sz_init..z SZuUURIZBAD_URIz UNICODE-RANGEz\_-ZFUNCTIONZIDENTz.+-Z DIMENSIONZ PERCENTAGENUMBER@Z ATKEYWORD#HASHz'"STRINGZ BAD_STRING/COMMENTZ BAD_COMMENT..Nr)rnamesrrrrs)r clearMACROS splitlinesrrr TOKENSr%r$ enumeraterangestring ascii_lettersunichrdigitsordextendTOKEN_DISPATCH) rrrrZregexpdispatchcharsr'charrrr_inits:       r8cCs(||jdd}||kr ||SdSdS)Nu�)group)r intr0 maxunicodeZ codepointrrr_unicode_replacesr>unicodez()\\nlz\\(%s)Z simple_escaper;r9c@s0eZdZdZdZdZd d Zd d Zd dZdS)Tokenu; A single atomic token. .. attribute:: is_container Always ``False``. Helps to tell :class:`Token` apart from :class:`ContainerToken`. .. attribute:: type The type of token as a string: ``S`` A sequence of white space ``IDENT`` An identifier: a name that does not start with a digit. A name is a sequence of letters, digits, ``_``, ``-``, escaped characters and non-ASCII characters. Eg: ``margin-left`` ``HASH`` ``#`` followed immediately by a name. Eg: ``#ff8800`` ``ATKEYWORD`` ``@`` followed immediately by an identifier. Eg: ``@page`` ``URI`` Eg: ``url(foo)`` The content may or may not be quoted. ``UNICODE-RANGE`` ``U+`` followed by one or two hexadecimal Unicode codepoints. Eg: ``U+20-00FF`` ``INTEGER`` An integer with an optional ``+`` or ``-`` sign ``NUMBER`` A non-integer number with an optional ``+`` or ``-`` sign ``DIMENSION`` An integer or number followed immediately by an identifier (the unit). Eg: ``12px`` ``PERCENTAGE`` An integer or number followed immediately by ``%`` ``STRING`` A string, quoted with ``"`` or ``'`` ``:`` or ``;`` That character. ``DELIM`` A single character not matched in another token. Eg: ``,`` See the source of the :mod:`.token_data` module for the precise regular expressions that match various tokens. Note that other token types exist in the early tokenization steps, but these are ignored, are syntax errors, or are later transformed into :class:`ContainerToken` or :class:`FunctionToken`. .. attribute:: value The parsed value: * INTEGER, NUMBER, PERCENTAGE or DIMENSION tokens: the numeric value as an int or float. * STRING tokens: the unescaped string without quotes * URI tokens: the unescaped URI without quotes or ``url(`` and ``)`` markers. * IDENT, ATKEYWORD or HASH tokens: the unescaped token, with ``@`` or ``#`` markers left as-is * Other tokens: same as :attr:`as_css` *Unescaped* refers to the various escaping methods based on the backslash ``\`` character in CSS syntax. .. attribute:: unit * DIMENSION tokens: the normalized (unescaped, lower-case) unit name as a string. eg. ``'px'`` * PERCENTAGE tokens: the string ``'%'`` * Other tokens: ``None`` .. attribute:: line The line number in the CSS source of the start of this token. .. attribute:: column The column number (inside a source line) of the start of this token. Ftype_as_cssrunitrcolumncCs(||_||_||_||_||_||_dS)N)rCrDrrErrF)selftype_Z css_valuerrErrFrrr__init__9s zToken.__init__cCs|jS)zs Return as an Unicode string the CSS representation of the token, as parsed in the source. )rD)rGrrras_cssAsz Token.as_csscCsdj||jpdS)Nz6rA)r rE)rGrrr__repr__HszToken.__repr__N)rCrDrrErrF) __name__ __module__ __qualname____doc__ is_container __slots__rIrJrKrrrrrBs ]rBc@s8eZdZdZdZdZdZd d Zd d ZdZ ddZ dS)ContainerTokenaYA token that contains other (nested) tokens. .. attribute:: is_container Always ``True``. Helps to tell :class:`ContainerToken` apart from :class:`Token`. .. attribute:: type The type of token as a string. One of ``{``, ``(``, ``[`` or ``FUNCTION``. For ``FUNCTION``, the object is actually a :class:`FunctionToken`. .. attribute:: unit Always ``None``. Included to make :class:`ContainerToken` behave more like :class:`Token`. .. attribute:: content A list of :class:`Token` or nested :class:`ContainerToken`, not including the opening or closing token. .. attribute:: line The line number in the CSS source of the start of this token. .. attribute:: column The column number (inside a source line) of the start of this token. TNrC _css_start_css_endcontentrrFcCs(||_||_||_||_||_||_dS)N)rCrSrTrUrrF)rGrH css_startcss_endrUrrFrrrrIrs zContainerToken.__init__cCs4|jg}|jdd|jD|j|jdj|S)zs Return as an Unicode string the CSS representation of the token, as parsed in the source. css|]}|jVqdS)N)rJ)rtokenrrrrsz(ContainerToken.as_css..rA)rSr3rUappendrTjoin)rGpartsrrrrJzs zContainerToken.as_cssz0cCs|jdj|S)Nz {0.content}) format_stringr )rGrrrrKszContainerToken.__repr__)rCrSrTrUrrF) rLrMrNrOrPrErQrIrJr\rKrrrrrRMs  rRcs(eZdZdZdZfddZdZZS) FunctionTokenzA specialized :class:`ContainerToken` for a ``FUNCTION`` group. Has an additional attribute: .. attribute:: function_name The unescaped name of the function, with the ``(`` marker removed. function_namecs,tt|j|||||||dd|_dS)Nr9)superr]rIr^)rGrHrVrWr^rUrrF) __class__rrrIs zFunctionToken.__init__z:)r^)rLrMrNrOrQrIr\ __classcell__rr)rarr]s r]c@s0eZdZdZeddZeddZddZdS) TokenLista  A mixed list of :class:`~.token_data.Token` and :class:`~.token_data.ContainerToken` objects. This is a subclass of the builtin :class:`~builtins.list` type. It can be iterated, indexed and sliced as usual, but also has some additional API: cCs |djS)z5The line number in the CSS source of the first token.r)r)rGrrrrszTokenList.linecCs |djS)z.)rZ)rGrrrrJszTokenList.as_cssN)rLrMrNrOpropertyrrFrJrrrrrcs   rc)(rO __future__rrsysoperator functoolsr.replacer)r+r r%r$r4r0 NameErrorchrstrr?r8r<r=r>partialr r subZUNICODE_UNESCAPEZNEWLINE_UNESCAPE methodcallerZSIMPLE_UNESCAPEfinditerZ FIND_NEWLINESobjectrBrRr]listrcrrrr sD 0+ 8u=