Module Import alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias ClassDef bases body FunctionDef arguments args NameParam NameParam NameParam defaults body Expr Call AttributeLoad Call NameLoad attr NameLoad NameLoad Assign AttributeStore NameLoad attr Call NameLoad AttributeLoad NameLoad attr Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str Str Str Str Str Str Str Str Str Str Str Str Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str Str Str Str Str Str Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr Set Str keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str decorator_list FunctionDef arguments args NameParam NameParam NameParam defaults NameLoad body Expr Str Assign NameStore Call NameLoad NameLoad If CompareIs NameLoad NameLoad body Assign NameStore Call AttributeLoad Str attr Str NameLoad Return Call AttributeLoad NameLoad attr AttributeLoad NameLoad attr AttributeLoad NameLoad attr keyword NameLoad decorator_list FunctionDef arguments args NameParam NameParam NameParam NameParam defaults NameLoad AttributeLoad NameLoad attr body Expr Str If UnaryOpNot Call NameLoad NameLoad Str body Assign NameStore Call AttributeLoad NameLoad attr NameLoad NameLoad If CompareIs NameLoad NameLoad body Assign NameStore Call AttributeLoad Str attr Str AttributeLoad NameLoad attr Return Call AttributeLoad NameLoad attr NameLoad AttributeLoad NameLoad attr keyword NameLoad decorator_list decorator_list ClassDef bases body FunctionDef arguments args NameParam defaults vararg kwarg body Expr Call AttributeLoad Call NameLoad attr NameLoad NameLoad Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad AttributeLoad NameLoad attr attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str Assign AttributeStore NameLoad attr Call AttributeLoad NameLoad attr AttributeLoad AttributeLoad AttributeLoad NameLoad attr attr attr AttributeLoad NameLoad attr keyword BinOpAdd AttributeLoad NameLoad attr Str Expr Str decorator_list decorator_list FunctionDef arguments args NameParam defaults body Return BoolOpAnd CompareGt Call NameLoad NameLoad Num CompareEq Call NameLoad GeneratorExp CompareNotEq Call AttributeLoad NameLoad attr NameLoad comprehension NameStore NameLoad Call NameLoad NameLoad decorator_list ClassDef bases body FunctionDef arguments args NameParam NameParam defaults body Assign AttributeStore NameLoad attr Call NameLoad NameLoad decorator_list FunctionDef arguments args NameParam NameParam defaults body Return CompareIn AttributeLoad NameLoad attr AttributeLoad NameLoad attr decorator_list decorator_list FunctionDef arguments args NameParam defaults body Return ListComp NameLoad comprehension NameStore Call AttributeLoad NameLoad attr BoolOpOr NameLoad Str decorator_list FunctionDef arguments args NameParam NameParam defaults NameLoad body Expr Str If CompareIs NameLoad NameLoad body Assign NameStore Call AttributeLoad Str attr Str NameLoad Return Call NameLoad NameLoad NameLoad keyword ListLoad NameLoad decorator_list
N/A N/A re deltas wikitext_split datasources Datasource datasources.meta filters frequencies mappers Revision N/A N/A __init__ N/A N/A self name revision_datasources N/A N/A N/A N/A N/A N/A super __init__ name revision_datasources N/A N/A self tokens N/A tokenized N/A revision_datasources text N/A 
        A list of all tokens
         N/A N/A self token_frequency N/A N/A frequencies table N/A self tokens name N/A N/A self _name .token_frequency N/A 
        A frequency table of all tokens.
         N/A N/A self numbers N/A N/A self tokens_in_types N/A number name N/A N/A self _name .numbers N/A 
        A list of numeric tokens
         N/A N/A self number_frequency N/A N/A frequencies table N/A self numbers name N/A N/A self _name .number_frequency N/A 
        A frequency table of number tokens.
         N/A N/A self whitespaces N/A N/A self tokens_in_types N/A whitespace name N/A N/A self _name .whitespaces N/A 
        A list of whitespace tokens
         N/A N/A self whitespace_frequency N/A N/A frequencies table N/A self whitespaces name N/A N/A self _name .whitespace_frequency N/A 
        A frequency table of whichspace tokens.
         N/A N/A self markups N/A N/A self tokens_in_types N/A dbrack_open dbrack_close brack_open brack_close tab_open tab_close dcurly_open dcurly_close curly_open curly_close bold italics equals name N/A N/A self _name .markups N/A 
        A list of markup tokens
         N/A N/A self markup_frequency N/A N/A frequencies table N/A self markups name N/A N/A self _name .markup_frequency N/A 
        A frequency table of markup tokens.
         N/A N/A self cjks N/A N/A self tokens_in_types N/A cjk name N/A N/A self _name .cjks N/A 
        A list of Chinese/Japanese/Korean tokens
         N/A N/A self cjk_frequency N/A N/A frequencies table N/A self cjks name N/A N/A self _name .cjk_frequency N/A 
        A frequency table of cjk tokens.
         N/A N/A self entities N/A N/A self tokens_in_types N/A entity name N/A N/A self _name .entities N/A 
        A list of HTML entity tokens
         N/A N/A self entity_frequency N/A N/A frequencies table N/A self entities name N/A N/A self _name .entity_frequency N/A 
        A frequency table of entity tokens.
         N/A N/A self urls N/A N/A self tokens_in_types N/A url name N/A N/A self _name .urls N/A 
        A list of URL tokens
         N/A N/A self url_frequency N/A N/A frequencies table N/A self urls name N/A N/A self _name .url_frequency N/A 
        A frequency table of url tokens.
         N/A N/A self words N/A N/A self tokens_in_types N/A word name N/A N/A self _name .words N/A 
        A list of word tokens
         N/A N/A self word_frequency N/A N/A frequencies table N/A N/A mappers lower_case N/A self words name N/A N/A self _name .word_frequency N/A 
        A frequency table of lower-cased word tokens.
         N/A N/A self uppercase_words N/A N/A filters filter is_uppercase_word N/A self words name N/A N/A self _name .uppercase_words N/A 
        A list of uppercase word tokens that are at least two
        characters long.
         N/A N/A self uppercase_word_frequency N/A N/A frequencies table N/A self uppercase_words name N/A N/A self _name .uppercase_word_frequency N/A 
        A frequency table of uppercase word tokens that are at least two
        characters long.
         N/A N/A self punctuations N/A N/A self tokens_in_types N/A period qmark epoint comma colon scolon japan_punct name N/A N/A self _name .punctuations N/A 
        A list of punctuation tokens
         N/A N/A self punctuation_frequency N/A N/A frequencies table N/A self punctuations name N/A N/A self _name .punctuation_frequency N/A 
        A frequency table of punctuation tokens.
         N/A N/A self breaks N/A N/A self tokens_in_types N/A break name N/A N/A self _name .breaks N/A 
        A list of break tokens
         N/A N/A self break_frequency N/A N/A frequencies table N/A self breaks name N/A N/A self _name .break_frequency N/A 
        A frequency table of break tokens.
         N/A tokens_in_types N/A N/A self types name N/A None N/A N/A 
        Constructs a :class:`revscoring.Datasource` that returns all content
        tokens that are within a set of types.
         N/A token_is_in_types N/A TokenIsInTypes types N/A N/A name None N/A N/A name N/A N/A {0}({1}) format tokens_in_types types N/A N/A N/A filters filter N/A token_is_in_types filter N/A self tokens name name N/A tokens_matching N/A N/A self regex name regex_flags N/A None N/A re I N/A N/A 
        Constructs a :class:`revscoring.Datasource` that returns all content
        tokens that match a regular expression.
         N/A N/A N/A hasattr regex pattern N/A N/A regex N/A N/A re compile regex regex_flags N/A N/A name None N/A N/A name N/A N/A {0}({1}) format tokens_matching N/A regex pattern N/A N/A N/A filters regex_matching regex N/A self tokens name name N/A N/A Diff N/A N/A __init__ N/A N/A self N/A args kwargs N/A N/A N/A N/A N/A super __init__ args kwargs N/A N/A self token_delta N/A N/A frequencies delta N/A N/A N/A self revision parent token_frequency N/A N/A self revision token_frequency name N/A N/A self _name .token_delta N/A 
        A token frequency delta table
         N/A N/A self token_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent token_frequency N/A self token_delta name N/A N/A self _name .token_prop_delta N/A 
        A token proportional frequency delta table
         N/A N/A self number_delta N/A N/A frequencies delta N/A N/A N/A self revision parent number_frequency N/A N/A self revision number_frequency name N/A N/A self _name .number_delta N/A 
        A number frequency delta table
         N/A N/A self number_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent number_frequency N/A self number_delta name N/A N/A self _name .number_prop_delta N/A 
        A number proportional frequency delta table
         N/A N/A self whitespace_delta N/A N/A frequencies delta N/A N/A N/A self revision parent whitespace_frequency N/A N/A self revision whitespace_frequency name N/A N/A self _name .whitespace_delta N/A 
        A whitespace frequency delta table
         N/A N/A self whitespace_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent whitespace_frequency N/A self whitespace_delta name N/A N/A self _name .whitespace_prop_delta N/A 
        A whitespace proportional frequency delta table
         N/A N/A self markup_delta N/A N/A frequencies delta N/A N/A N/A self revision parent markup_frequency N/A N/A self revision markup_frequency name N/A N/A self _name .markup_delta N/A 
        A markup frequency delta table
         N/A N/A self markup_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent markup_frequency N/A self markup_delta name N/A N/A self _name .markup_prop_delta N/A 
        A markup proportional frequency delta table
         N/A N/A self cjk_delta N/A N/A frequencies delta N/A N/A N/A self revision parent cjk_frequency N/A N/A self revision cjk_frequency name N/A N/A self _name .cjk_delta N/A 
        A cjk frequency delta table
         N/A N/A self cjk_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent cjk_frequency N/A self cjk_delta name N/A N/A self _name .cjk_prop_delta N/A 
        A cjk proportional frequency delta table
         N/A N/A self entity_delta N/A N/A frequencies delta N/A N/A N/A self revision parent entity_frequency N/A N/A self revision entity_frequency name N/A N/A self _name .entity_delta N/A 
        A entity frequency delta table
         N/A N/A self entity_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent entity_frequency N/A self entity_delta name N/A N/A self _name .entity_prop_delta N/A 
        A entity proportional frequency delta table
         N/A N/A self url_delta N/A N/A frequencies delta N/A N/A N/A self revision parent url_frequency N/A N/A self revision url_frequency name N/A N/A self _name .url_delta N/A 
        A url frequency delta table
         N/A N/A self url_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent url_frequency N/A self url_delta name N/A N/A self _name .url_prop_delta N/A 
        A url proportional frequency delta table
         N/A N/A self word_delta N/A N/A frequencies delta N/A N/A N/A self revision parent word_frequency N/A N/A self revision word_frequency name N/A N/A self _name .word_delta N/A 
        A lower-cased word frequency delta table
         N/A N/A self word_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent word_frequency N/A self word_delta name N/A N/A self _name .word_prop_delta N/A 
        A lower-cased word proportional frequency delta table
         N/A N/A self uppercase_word_delta N/A N/A frequencies delta N/A N/A N/A self revision parent uppercase_word_frequency N/A N/A self revision uppercase_word_frequency name N/A N/A self _name .uppercase_word_delta N/A 
        A uppercase word frequency delta table
         N/A N/A self uppercase_word_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent uppercase_word_frequency N/A self uppercase_word_delta name N/A N/A self _name .uppercase_word_prop_delta N/A 
        A uppercase word proportional frequency delta table
         N/A N/A self punctuation_delta N/A N/A frequencies delta N/A N/A N/A self revision parent punctuation_frequency N/A N/A self revision punctuation_frequency name N/A N/A self _name .punctuation_delta N/A 
        A punctuation frequency delta table
         N/A N/A self punctuation_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent punctuation_frequency N/A self punctuation_delta name N/A N/A self _name .punctuation_prop_delta N/A 
        A punctuation proportional frequency delta table
         N/A N/A self break_delta N/A N/A frequencies delta N/A N/A N/A self revision parent break_frequency N/A N/A self revision break_frequency name N/A N/A self _name .break_delta N/A 
        A break frequency delta table
         N/A N/A self break_prop_delta N/A N/A frequencies prop_delta N/A N/A N/A self revision parent break_frequency N/A self break_delta name N/A N/A self _name .break_prop_delta N/A 
        A break proportional frequency delta table
         N/A N/A is_uppercase_word N/A N/A word_token N/A N/A N/A N/A N/A N/A len word_token 1 N/A N/A sum N/A N/A N/A N/A c lower c N/A c word_token N/A len word_token N/A TokenIsInTypes N/A N/A __init__ N/A N/A self types N/A N/A N/A N/A self types N/A set types N/A filter N/A N/A self token N/A N/A N/A N/A N/A token type N/A self types N/A N/A _process_tokens N/A N/A text N/A N/A N/A N/A t N/A t N/A N/A wikitext_split tokenize N/A text N/A tokenized N/A N/A text_datasource name N/A None N/A N/A 
    Constructs a :class:`revision.Datasource` that generates a list of tokens
     N/A N/A name None N/A N/A name N/A N/A {0}({1}) format tokenized text_datasource N/A N/A Datasource name _process_tokens depends_on N/A text_datasource N/A