upstream Irish dictionary changes (focal.ie)
Twitter corpus work
subtle bug because of memoizing; wasn't counting unknowns after first appearance
do eval correctly when verbose is true
handle newlines, unicode quotes in detokenizer
handle SGML, newlines properly (shouldn't affect n-grams)
weird pair
don't lowercase sgml tags