Package: chirptext
ChirpText is a collection of text processing tools for Python 3.It is not meant to be a powerful tank like the popular NTLK but a small package which you can pip-install anywhere and write a few lines of code to process textual data.Main featuresSimple file data manipulation using an enhancedopen()function (txt, gz, binary, etc.)CSV helper functionsParse Japanese text with mecab library (Does not requiremecab-python3package even on Windows, only a binary release (i.e.mecab.exe) is required)Built-in "lite"text annotation formats(texttaglibTTL/CSV and TTL/JSON)Helper functions and useful data for processing English, Japanese, Chinese and Vietnamese.Application configuration files management which can make educated guess about config files' whereaboutsQuick text-based report generationInstallationchirptextis available onPyPIand can be installed using pippipinstallchirptextNote: chirptext library does not support Python 2 anymore. Please update to Python 3 to use this package.Sample codesUsing MeCab on WindowsYou can download mecab binary package fromhttp://taku910.github.io/mecab/#downloadand install it.
After installed you can try:>>>fromchirptextimportdeko>>>sent=deko.parse('猫が好きです。')>>>sent.tokens[[猫(名詞-一般/*/*|猫|ネコ|ネコ)],[が(助詞-格助詞/一般/*|が|ガ|ガ)],[好き(名詞-形容動詞語幹/*/*|好き|スキ|スキ)],[です(助動詞-*/*/*|です|デス|デス)],[。(記号-句点/*/*|。|。|。)],[EOS(-//|||)]]>>>sent.words['猫','が','好き','です','。']>>>sent[0].pos'名詞'>>>sent[0].root'猫'>>>sent[0].reading'ネコ'If you installed MeCab to a custom location, for exampleC:\mecab\bin\mecab.exe, try>>>deko.set_mecab_bin("C:\\mecab\\bin\\mecab.exe")>>>deko.get_mecab_bin()'C:\\mecab\\bin\\mecab.exe'# Just that & now you can use mecab>>>deko.parse('雨が降る。').words['雨','が','降る','。']Convenient IO APIs>>>fromchirptextimportchio>>>chio.write_tsv('data/test.tsv',[['a','b'],['c','d']])>>>chio.read_tsv('data/tes.tsv')[['a','b'],['c','d']]>>>chio.write_file('data/content.tar.gz','Support writing to .tar.gz file')>>>chio.read_file('data/content.tar.gz')'Support writing to .tar.gz file'>>>forrowinchio.read_tsv_iter('data/test.tsv'):...print(row)...['a','b']['c','d']Sample TextReport# a string reportrp=TextReport()# by default, TextReport will write to standard output, i.e. terminalrp=TextReport(TextReport.STDOUT)# same as aboverp=TextReport('~/tmp/my-report.txt')# output to a filerp=TextReport.null()# ouptut to /dev/null, i.e. nowhererp=TextReport.string()# output to a string. Call rp.content() to get the stringrp=TextReport(TextReport.STRINGIO)# same as above# TextReport will close the output stream automatically by using the with statementwithTextReport.string()asrp:rp.header("Lorem Ipsum Analysis",level="h0")rp.header("Raw",level="h1")rp.print(LOREM_IPSUM)rp.header("Top 5 most common letters")ct.summarise(report=rp,limit=5)print(rp.content())Output+---------------------------------------------------------------------------------- 
| Lorem Ipsum Analysis 
+---------------------------------------------------------------------------------- 
 
Raw 
------------------------------------------------------------ 
Lorem ipsum dolor sit amet, consectetur adipiscing elit, sed do eiusmod tempor incididunt ut labore et dolore magna aliqua. Ut enim ad minim veniam, quis nostrud exercitation ullamco laboris nisi ut aliquip ex ea commodo consequat. Duis aute irure dolor in reprehenderit in voluptate velit esse cillum dolore eu fugiat nulla pariatur. Excepteur sint occaecat cupidatat non proident, sunt in culpa qui officia deserunt mollit anim id est laborum. 
 
Top 5 most common letters
------------------------------------------------------------ 
i: 42 
e: 37 
t: 32 
o: 29 
a: 29Useful linksDocumentation:https://chirptext.readthedocs.ioSource code:https://github.com/letuananh/chirptext/PyPI:https://pypi.org/project/chirptext/