Module ImportFrom alias Import alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias ImportFrom alias Assign NameStore Num Assign NameStore Num ClassDef bases NameLoad body Expr Str Assign NameStore NameLoad Assign NameStore NameLoad FunctionDef arguments args NameParam NameParam NameParam defaults body Assign AttributeStore NameLoad attr NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list decorator_list ClassDef bases NameLoad body Expr Str Assign NameStore NameLoad Assign NameStore NameLoad FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults NameLoad Num NameLoad body If UnaryOpNot Call NameLoad NameLoad NameLoad body Raise Call AttributeLoad NameLoad attr Str If NameLoad body ImportFrom alias Assign NameStore Num Assign NameStore Call NameLoad Assign NameStore Call AttributeLoad NameLoad attr Assign NameStore Call AttributeLoad NameLoad attr Str Assign NameStore Num For NameStore NameLoad body If Call NameLoad NameLoad NameLoad body Assign NameStore Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr For NameStore AttributeLoad NameLoad attr body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad AugAssignAdd NameStore Num orelse If Call NameLoad NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad NameLoad AugAssignAdd NameStore Num orelse Raise Call AttributeLoad NameLoad attr NameLoad Str If NameLoad body Assign NameStore Call NameLoad Assign NameStore BinOpAdd NameLoad BinOpSub NameLoad NameLoad Assign NameStore Call NameLoad If BoolOpAnd NameLoad BinOpBitAnd NameLoad Num body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr NameLoad keyword BoolOpAnd CompareEq BinOpBitAnd NameLoad Num Num NameLoad If NameLoad body Assign NameStore Call NameLoad Assign NameStore BinOpAdd NameLoad BinOpSub NameLoad NameLoad If BoolOpAnd NameLoad BinOpBitAnd NameLoad Num body Expr Call AttributeLoad NameLoad attr Str Expr Call AttributeLoad NameLoad attr NameLoad If NameLoad body Expr Call AttributeLoad NameLoad attr BinOpMod Str BinOpSub NameLoad NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str BinOpSub NameLoad NameLoad Expr Call AttributeLoad NameLoad attr BinOpMod Str NameLoad Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam NameParam defaults body TryExcept body Assign TupleStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad If Call NameLoad NameLoad AttributeLoad NameLoad attr body Assign NameStore NameLoad orelse TryExcept body Expr AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad orelse Assign NameStore Call AttributeLoad NameLoad attr NameLoad Assign NameStore Call AttributeLoad NameLoad attr Expr Call AttributeLoad NameLoad attr NameLoad NameLoad NameLoad keyword Num keyword Num Expr Call AttributeLoad NameLoad attr NameLoad keyword UnaryOpUSub NameLoad handlers ExceptHandler type AttributeLoad NameLoad attr name NameStore body Raise Call AttributeLoad NameLoad attr BinOpMod Str TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body If UnaryOpNot Call NameLoad NameLoad NameLoad body Raise Call AttributeLoad NameLoad attr Str If CompareNotEq Call NameLoad NameLoad Num body Raise Call AttributeLoad NameLoad attr Str Assign TupleStore NameStore NameStore NameLoad If UnaryOpNot Call NameLoad NameLoad AttributeLoad NameLoad attr body Raise Call AttributeLoad NameLoad attr Str Return TupleLoad NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Return Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list decorator_list
N/A __future__ absolute_import N/A types N/A Actions N/A DFA N/A Errors N/A Machines N/A Regexps N/A DUMP_NFA 1 N/A DUMP_DFA 2 State N/A object N/A N/A 
    This class is used as part of a Plex.Lexicon specification to
    introduce a user-defined state.

    Constructor:

       State(name, token_specifications)
     N/A name None N/A tokens None __init__ N/A N/A self name tokens N/A N/A N/A N/A self name name N/A N/A self tokens tokens N/A N/A Lexicon N/A object N/A N/A 
    Lexicon(specification) builds a lexical analyser from the given
    |specification|. The specification consists of a list of
    specification items. Each specification item may be either:

       1) A token definition, which is a tuple:

             (pattern, action)

          The |pattern| is a regular axpression built using the
          constructors defined in the Plex module.

          The |action| is the action to be performed when this pattern
          is recognised (see below).

       2) A state definition:

             State(name, tokens)

          where |name| is a character string naming the state,
          and |tokens| is a list of token definitions as
          above. The meaning and usage of states is described
          below.

    Actions
    -------

    The |action| in a token specication may be one of three things:

       1) A function, which is called as follows:

             function(scanner, text)

          where |scanner| is the relevant Scanner instance, and |text|
          is the matched text. If the function returns anything
          other than None, that value is returned as the value of the
          token. If it returns None, scanning continues as if the IGNORE
          action were specified (see below).

        2) One of the following special actions:

           IGNORE means that the recognised characters will be treated as
                  white space and ignored. Scanning will continue until
                  the next non-ignored token is recognised before returning.

           TEXT   causes the scanned text itself to be returned as the
                  value of the token.

        3) Any other value, which is returned as the value of the token.

    States
    ------

    At any given time, the scanner is in one of a number of states.
    Associated with each state is a set of possible tokens. When scanning,
    only tokens associated with the current state are recognised.

    There is a default state, whose name is the empty string. Token
    definitions which are not inside any State definition belong to
    the default state.

    The initial state of the scanner is the default state. The state can
    be changed in one of two ways:

       1) Using Begin(state_name) as the action of a token.

       2) Calling the begin(state_name) method of the Scanner.

    To change back to the default state, use '' as the state name.
     N/A machine None N/A tables None __init__ N/A N/A self specifications debug debug_flags timings N/A None 7 None N/A N/A N/A N/A isinstance specifications list N/A N/A N/A N/A Errors InvalidScanner Scanner definition is not a list N/A timings N/A Timing time N/A total_time 0.0 N/A time1 N/A time N/A nfa N/A N/A Machines Machine N/A default_initial_state N/A N/A nfa new_initial_state N/A token_number 1 N/A spec specifications N/A N/A N/A isinstance spec State N/A N/A user_initial_state N/A N/A nfa new_initial_state N/A spec name N/A token N/A spec tokens N/A N/A N/A N/A self add_token_to_machine nfa user_initial_state token token_number N/A token_number 1 N/A N/A N/A isinstance spec tuple N/A N/A N/A N/A self add_token_to_machine nfa default_initial_state spec token_number N/A token_number 1 N/A N/A N/A N/A Errors InvalidToken token_number Expected a token definition (tuple) or State instance N/A timings N/A N/A time2 N/A time N/A total_time N/A total_time N/A time2 time1 N/A time3 N/A time N/A N/A debug N/A debug_flags 1 N/A N/A N/A N/A debug write 
============= NFA ===========
 N/A N/A N/A nfa dump debug N/A dfa N/A N/A DFA nfa_to_dfa nfa debug N/A N/A N/A debug_flags 3 3 debug N/A timings N/A N/A time4 N/A time N/A total_time N/A total_time N/A time4 time3 N/A N/A debug N/A debug_flags 2 N/A N/A N/A N/A debug write 
============= DFA ===========
 N/A N/A N/A dfa dump debug N/A timings N/A N/A N/A N/A timings write N/A Constructing NFA : %5.2f
 N/A time2 time1 N/A N/A N/A timings write N/A Converting to DFA: %5.2f
 N/A time4 time3 N/A N/A N/A timings write N/A TOTAL            : %5.2f
 total_time N/A N/A self machine dfa N/A add_token_to_machine N/A N/A self machine initial_state token_spec token_number N/A N/A N/A N/A N/A N/A re action_spec N/A N/A self parse_token_definition token_spec N/A N/A isinstance action_spec N/A Actions Action N/A N/A action action_spec N/A N/A N/A N/A N/A action_spec __call__ N/A N/A N/A AttributeError N/A N/A action N/A N/A Actions Return action_spec N/A N/A action N/A N/A Actions Call action_spec N/A final_state N/A N/A machine new_state N/A N/A N/A re build_machine machine initial_state final_state match_bol 1 nocase 0 N/A N/A N/A final_state set_action action priority N/A token_number N/A N/A N/A N/A Errors PlexError N/A e N/A N/A N/A N/A e __class__ N/A Token number %d: %s N/A token_number e N/A parse_token_definition N/A N/A self token_spec N/A N/A N/A N/A N/A isinstance token_spec tuple N/A N/A N/A N/A Errors InvalidToken Token definition is not a tuple N/A N/A N/A len token_spec 2 N/A N/A N/A N/A Errors InvalidToken Wrong number of items in token definition N/A N/A pattern action token_spec N/A N/A N/A isinstance pattern N/A Regexps RE N/A N/A N/A N/A Errors InvalidToken Pattern is not an RE instance N/A N/A pattern action N/A get_initial_state N/A N/A self name N/A N/A N/A N/A N/A N/A self machine get_initial_state name N/A N/A