Module Import alias Import alias Import alias Import alias Import alias ImportFrom alias identifier ClassDef bases NameLoad body Assign NameStore NameLoad FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults body If AttributeLoad NameLoad attr body Raise Call AttributeLoad NameLoad attr Expr Call AttributeLoad Call NameLoad NameLoad NameLoad attr NameLoad NameLoad decorator_list decorator_list ClassDef bases NameLoad body FunctionDef arguments args NameParam defaults body For TupleStore NameStore NameStore Call AttributeLoad NameLoad attr Lambda arguments args NameParam defaults TupleLoad NameLoad Call NameLoad NameLoad NameLoad Call NameLoad NameLoad body If UnaryOpNot Call AttributeLoad NameLoad attr Str body Expr Yield NameLoad decorator_list decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad Call AttributeLoad NameLoad attr Str keyword Str Assign NameStore Call AttributeLoad NameLoad attr Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr Str AttributeLoad NameLoad attr NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults Num NameLoad body Assign NameStore Call NameLoad NameLoad Assign NameStore BoolOpOr NameLoad Call NameLoad GeneratorExp Call AttributeLoad NameLoad attr comprehension NameStore Call AttributeLoad NameLoad attr Str Return ListComp NameLoad comprehension NameStore NameLoad BoolOpAnd CompareGtE Call NameLoad NameLoad NameLoad CompareNotIn NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults Num body Expr Str Assign NameStore Call NameLoad NameLoad Assign NameStore Call NameLoad NameLoad Assign NameStore Call NameLoad Lambda arguments args NameParam defaults BoolOpAnd CompareGt Call NameLoad NameLoad Num UnaryOpNot Call AttributeLoad NameLoad attr NameLoad Assign NameStore Num Assign NameStore ListLoad While CompareLt NameLoad Call NameLoad NameLoad body Assign NameStore Str For NameStore Call NameLoad NameLoad body If CompareLt BinOpAdd NameLoad NameLoad Call NameLoad NameLoad body AugAssignAdd NameStore SubscriptLoad NameLoad Index BinOpAdd NameLoad NameLoad Expr Call AttributeLoad NameLoad attr NameLoad AugAssignAdd NameStore NameLoad If UnaryOpNot NameLoad body Assign NameStore ListLoad Str Return NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults Num body Return Call NameLoad ListComp Call NameLoad NameLoad comprehension NameStore NameLoad decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad Str attr ListComp Call NameLoad BinOpAdd Call NameLoad Str Call AttributeLoad NameLoad attr Num Num comprehension NameStore Call NameLoad BinOpSub NameLoad Num Return NameLoad decorator_list FunctionDef arguments args NameParam defaults body Return Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad decorator_list FunctionDef arguments args defaults body Return CompareNotEq Call AttributeLoad NameLoad attr Num Call AttributeLoad NameLoad attr Num decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str If UnaryOpNot Call NameLoad NameLoad NameLoad body Raise Call NameLoad BinOpMod Call NameLoad Str NameLoad Assign NameStore BoolOpOr NameLoad Call NameLoad TryExcept body Assign NameStore Call AttributeLoad NameLoad attr handlers ExceptHandler type NameLoad body Assign NameStore Call AttributeLoad NameLoad attr NameLoad For NameStore NameLoad body If CompareNotIn NameLoad NameLoad body Expr Call AttributeLoad NameLoad attr NameLoad Expr Yield NameLoad For NameStore Call NameLoad NameLoad NameLoad body Expr Yield NameLoad decorator_list FunctionDef arguments args NameParam defaults body Expr Str Assign NameStore BinOpAdd ListLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Str Call AttributeLoad NameLoad attr Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad For TupleStore NameStore NameStore NameStore Call AttributeLoad NameLoad attr NameLoad body For NameStore NameLoad body If BoolOpOr Call AttributeLoad NameLoad attr Str UnaryOpNot Call AttributeLoad NameLoad attr Str body Continue Assign NameStore SubscriptLoad Call AttributeLoad Call AttributeLoad Str attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr attr Str Index Num Assign NameStore BinOpMod Str TupleLoad NameLoad SubscriptLoad NameLoad Slice Num If CompareNotIn NameLoad AttributeLoad NameLoad attr body Expr Call NameLoad NameLoad decorator_list
N/A N/A itertools N/A os N/A random N/A re N/A sys nltk.corpus stopwords nltk_stopwords ImmutableMixin N/A object N/A N/A _inited False __init__ N/A N/A self N/A N/A N/A N/A self _inited True N/A __setattr__ N/A N/A self key value N/A N/A N/A N/A self _inited N/A N/A N/A N/A exceptions ImmutableException N/A N/A N/A N/A super ImmutableMixin self __setattr__ key value N/A N/A EnumMixin N/A object N/A __iter__ N/A N/A self N/A N/A N/A N/A k v N/A N/A itertools imap N/A N/A N/A x N/A N/A x N/A getattr self x N/A dir self N/A N/A N/A N/A N/A k startswith _ N/A N/A N/A v N/A N/A prepare_text N/A N/A text N/A N/A N/A text N/A unicode N/A N/A text decode utf-8 errors replace N/A text N/A N/A text upper N/A text N/A tokenize N/A N/A text N/A N/A N/A N/A N/A re findall N/A N/A re compile [\w']+ N/A re U text N/A tokenize_and_filter N/A N/A text min_word_length stopwords N/A 3 None N/A N/A tokens N/A tokenize text N/A stopwords N/A stopwords N/A set N/A N/A N/A word upper N/A word N/A N/A nltk_stopwords words english N/A N/A token N/A token tokens N/A N/A N/A len token min_word_length N/A token stopwords N/A text_to_strings_collection N/A N/A text words N/A 3 N/A N/A 
    Splits the text to a collection of strings;
    a GAST for such a split collection usually produces
    better results in keyword matching that a GAST
    for the whole text. The word parameters determines
    how many words each string in the collection shall
    consist of (3 by default)
    
    return: Unicode
     N/A text N/A prepare_text text N/A strings_collection N/A tokenize text N/A strings_collection N/A filter N/A N/A N/A s N/A N/A N/A N/A len s 2 N/A N/A N/A s isdigit strings_collection N/A i 0 N/A strings_collection_grouped N/A N/A N/A i N/A len strings_collection N/A N/A group N/A j N/A xrange words N/A N/A N/A N/A i j N/A len strings_collection N/A N/A group N/A strings_collection N/A N/A i j N/A N/A N/A strings_collection_grouped append group N/A i words N/A N/A strings_collection_grouped N/A N/A strings_collection_grouped N/A N/A strings_collection_grouped N/A text_collection_to_string_collection N/A N/A text_collection words N/A 3 N/A N/A N/A flatten N/A N/A text_to_strings_collection text N/A text text_collection N/A random_string N/A N/A length N/A N/A N/A string N/A N/A join N/A N/A unichr N/A N/A ord A N/A N/A random randint 0 25 N/A _ N/A xrange N/A length 2 N/A string N/A flatten N/A N/A lst N/A N/A N/A N/A list N/A N/A N/A itertools chain from_iterable lst N/A output_is_redirected N/A N/A N/A N/A N/A N/A N/A N/A os fstat 0 N/A N/A os fstat 1 N/A itersubclasses N/A N/A cls _seen N/A None N/A N/A Generator over all subclasses of a given class in depth first order. N/A N/A N/A isinstance cls type N/A N/A N/A TypeError N/A N/A _ itersubclasses must be called with new-style classes, not %.100r cls N/A _seen N/A _seen N/A set N/A N/A N/A subs N/A N/A cls __subclasses__ N/A N/A N/A TypeError N/A N/A subs N/A N/A cls __subclasses__ cls N/A sub subs N/A N/A N/A sub _seen N/A N/A N/A N/A _seen add sub N/A N/A sub N/A sub N/A itersubclasses sub _seen N/A N/A N/A sub N/A import_modules_from_package N/A N/A package N/A N/A N/A Import modules from package and append into sys.modules

    :param package: full package name, e.g. east.asts
     N/A path N/A N/A N/A N/A N/A os path dirname __file__ .. N/A N/A package split . N/A path N/A N/A N/A os path join path N/A N/A root dirs files N/A N/A os walk path N/A N/A filename files N/A N/A N/A N/A N/A filename startswith __ N/A N/A N/A filename endswith .py N/A N/A N/A new_package N/A N/A N/A N/A N/A . join N/A N/A root split N/A os sep split .... N/A 1 N/A module_name N/A %s.%s N/A new_package N/A filename N/A -3 N/A N/A module_name N/A sys modules N/A N/A N/A __import__ module_name N/A