Module Import alias ImportFrom alias ImportFrom alias ImportFrom alias alias alias alias ImportFrom alias FunctionDef arguments args NameParam defaults body If NameLoad body Return Call NameLoad NameLoad Str orelse Return Call NameLoad NameLoad Str decorator_list ClassDef bases AttributeLoad NameLoad attr body FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Pass decorator_list FunctionDef arguments args NameParam defaults body Expr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr ListLoad Str Str Str Str Str Str Str decorator_list FunctionDef arguments args NameParam defaults body Expr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr keyword NameLoad ListLoad Str Str Str Str Str Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call NameLoad Call NameLoad NameLoad Str Expr Call NameLoad Call NameLoad NameLoad Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad AttributeLoad NameLoad attr Expr Call NameLoad Call NameLoad NameLoad Expr Call NameLoad Call NameLoad NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr decorator_list decorator_list ClassDef bases AttributeLoad NameLoad attr body FunctionDef arguments args NameParam defaults body Assign AttributeStore NameLoad attr Call NameLoad Assign AttributeStore NameLoad attr Str decorator_list FunctionDef arguments args NameParam defaults body Expr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr ListLoad Str Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Str Expr Call NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad ListLoad Str Str Str Assign NameStore Str Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr NameLoad Expr Call NameLoad Call NameLoad NameLoad Num Expr Call NameLoad NameLoad ListLoad Str Str decorator_list Call NameLoad Str FunctionDef arguments args NameParam defaults body Assign NameStore Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr Expr Call NameLoad Call NameLoad NameLoad Str Expr Call NameLoad Call NameLoad NameLoad Str decorator_list FunctionDef arguments args NameParam defaults body Assign NameStore Call NameLoad AttributeLoad NameLoad attr Expr Call NameLoad Call NameLoad NameLoad Expr Call NameLoad Call NameLoad NameLoad Call AttributeLoad AttributeLoad NameLoad attr attr AttributeLoad NameLoad attr decorator_list decorator_list If CompareEq NameLoad Str body Expr Call AttributeLoad NameLoad attr
N/A N/A unittest nose.plugins.attrib attr nose.tools * textblob.tokenizers WordTokenizer SentenceTokenizer word_tokenize sent_tokenize textblob.compat PY2 is_generator N/A N/A obj N/A N/A N/A PY2 N/A N/A N/A hasattr obj next N/A N/A N/A hasattr obj __next__ N/A TestWordTokenizer N/A N/A unittest TestCase N/A setUp N/A N/A self N/A N/A N/A N/A self tokenizer N/A WordTokenizer N/A N/A self text Python is a high-level programming language. N/A tearDown N/A N/A self N/A N/A N/A N/A test_tokenize N/A N/A self N/A N/A N/A N/A assert_equal N/A N/A N/A self tokenizer tokenize N/A self text N/A Python is a high-level programming language . N/A test_exclude_punc N/A N/A self N/A N/A N/A N/A assert_equal N/A N/A N/A self tokenizer tokenize N/A self text include_punc False N/A Python is a high-level programming language N/A test_itokenize N/A N/A self N/A N/A N/A gen N/A N/A N/A self tokenizer itokenize N/A self text N/A N/A assert_equal N/A next gen Python N/A N/A assert_equal N/A next gen is N/A test_word_tokenize N/A N/A self N/A N/A N/A tokens N/A word_tokenize N/A self text N/A N/A assert_true N/A is_generator tokens N/A N/A assert_equal N/A list tokens N/A N/A N/A self tokenizer tokenize N/A self text N/A N/A TestSentenceTokenizer N/A N/A unittest TestCase N/A setUp N/A N/A self N/A N/A N/A N/A self tokenizer N/A SentenceTokenizer N/A N/A self text Beautiful is better than ugly. Simple is better than complex. N/A test_tokenize N/A N/A self N/A N/A N/A N/A assert_equal N/A N/A N/A self tokenizer tokenize N/A self text N/A Beautiful is better than ugly. Simple is better than complex. N/A test_tokenize_with_multiple_punctuation N/A N/A self N/A N/A N/A text Hello world. How do you do?! My name's Steve... N/A N/A assert_equal N/A N/A N/A self tokenizer tokenize text N/A Hello world. How do you do?! My name's Steve... N/A text2 OMG! I am soooo LOL!!! N/A tokens N/A N/A N/A self tokenizer tokenize text2 N/A N/A assert_equal N/A len tokens 2 N/A N/A assert_equal tokens N/A OMG! I am soooo LOL!!! N/A N/A attr skip test_itokenize N/A N/A self N/A N/A N/A gen N/A N/A N/A self tokenizer itokenize N/A self text N/A N/A assert_equal N/A next gen Beautiful is better than ugly. N/A N/A assert_equal N/A next gen Simple is better than complex. N/A test_sent_tokenize N/A N/A self N/A N/A N/A tokens N/A sent_tokenize N/A self text N/A N/A assert_true N/A is_generator tokens N/A N/A assert_equal N/A list tokens N/A N/A N/A self tokenizer tokenize N/A self text N/A N/A N/A N/A __name__ __main__ N/A N/A N/A N/A unittest main