Uniform treatment of strings in Unicode. Non-ASCII chars are now considered in strings, which allows for matches in Cyrillic, Chinese, Greek, etc.
Added file for processing strings.
Unicode support in benchmark.py
ENG-741: having a true benchmark, to see when we improve stuff
Proper benchmark display. Introduce methods to explicitly do all the unicode preprocessing *before* using fuzz lib.
Simplified processing of strings with built-in regex code in python. Also fixed empty string detection in token_sort_ratio.
Fixed comment.
Re-upped the limit on benchmark, now that performance is not an issue anymore.
ENG-741 cut long lines in fuzzy wizzy benchmark
ENG-741 commented code removed not erased for review from creator
Fixed Unicode flag for tests.
ENG-741 fixed benchmark line length
Added a test for non letters/digits replacements.
re-commit asciidammit and add a parameter to full_process to determine behavior
utility method to make things consistent
add back relevant tests
handle force_ascii in fuzz methods
indentation fix
further honoring of force_ascii
fix merge conflict