Package: homer-text
HomerHomer is a Python package that can help make your text more clear, simple and useful for the reader.It provides information on an overall text as well as on individual paragraphs. It gives insights into readability, length of paragraphs, length of sentences, average sentences per paragraph, average words in a sentence, etc. It also tries to identify certain kind of vague words. It also tracks the frequency of "and" words in the text. (More information on all of these follows in theAcknowledgementssection.)This software package grew out of a personal need. Since I am not a native English speaker but am interested in writing, I designed and have been using Homer to improve my writing. I hope others will find it useful.Please note that this is not a strict guide to control your writing. At least, I don't use it that way. I use it as a guide to make my writing as simple as possible. I strive to write concise paragraphs and sentences as well as use fewer unclear words, and Homer has been helping me.I have only used it to analyze my blogs and essays and not the large corpus of text. As this software is new, you may well spot bugs, in which case please feel free to open up issues/pull-requests.You can use Homer as a stand-alone package or on the command line. If you run it on the command line, you can get general stats on your article or essay as well as paragraph stats.FeaturesArticle/Essay StatsRunning Homer from the command line gives the following insights about the article/essay:Reading time in minutes (although this will vary some from reader to reader).Readability scores (Flesch reading ease and Dale Chall readability scores).Total paragraphs, sentences, and words.Average sentences per paragraph.Average words per sentence."and" frequency.Number and list of compulsive hedgers, intensifiers, vague words.Paragraph StatsParagraph stats point out the following information foreach paragraph:Number of sentences and words.Average words per sentence.The longest sentence in the paragraph.Readability scores (Flesch reading ease and Dale Chall readability scores).If the number of sentences is more than five in a paragraph, then Homer gives a warning highlighted in red.Similarly, when the number of words is more than 25 in a sentence, then a warning highlighted in red is given.InstallationPythonI built this on Python 3.4.5. So first we need to install Python.On Mac, I used Homebrew to install Python e.g. one can use this command:brewinstallpython3To install on Windows, you can download the installer fromhere. Once downloaded this installer can be run to complete Python's installation.For Ubuntu you might find thisresourceuseful.Virtual environmentNow it's time to create a virtual environment (assuming you cloned the code under~/code/homer).~/code/homer>python3-mvenvvenv
~/code/homer>sourcevenv/bin/activateFirst line in the above snippet creates a virtual environment namedvenvunder~/code/homer. The second command activates the virtual environment.In case you need more help with creating a virtual environment thisresourcecan prove to be useful.InstallingHomervia PipInstall using Pip:~/code/homer>pipinstallhomer-textAnd that's it.UsageCommand lineA command line utility, under thehomerdirectory, has been provided. Here is an example showing how to use it:>pythonhomer_cmd.py--namearticle_name--authorlalala--file_path=/correct/path/to/file.txtBoth--nameand--authorare optional whereasfile_pathis mandatory.CodeYou can also use Homer in your code. Here is an example:fromhomer.analyzerimportArticlearticle=Article('Article name','Author',open('/file/path/article.txt').read())article.print_article_stats()article.print_paragraph_stats()TestsTests can be run from thetestsdirectory.AuthorsWaqas Younas(waqas.younas@gmail.com)AcknowledgementsSteven Pinker'sThe Sense of Style: The Thinking Person's Guide to Writing in the 21st Century. This book gave me quite a few insights. It also prompted me to include tracking of vague words, complex hedgers and intensifiers.Complex hedgers: These are words such asapparently, almost, fairly, nearly, partially, predominantly, presumably, rather, relative, seemingly, etc.Intensifiers: Words such asvery, highly, extremely.Bankspeak:
The Language
of World Bank Reports,
1946–2012:https://litlab.stanford.edu/LiteraryLabPamphlet9.pdf. This source also gave me a few ideas. The idea to keep track of "and" and the vague words in a text was taken from here."and" frequency: Basically it is the number of times the word "and" is used in the text (given as a percentage of total text). I try to keep it under 3 %.Vague words is a list of words I compiled after reading the above report.  Using these words unnecessarily, or without giving them the proper context, can make a text more abstract. These are words such asderivative, fair value, portfolio, evaluation, strategy, competitiveness, reform, growth, capacity, progress, stability, protection, access, sustainable, etc.ContributingPull requests are welcome. For major changes, please open an issue first to discuss what you would like to change.Please make sure to update tests as appropriate. Also, add your name underAuthorssection of thereadmefile.LicenseMIT