trying to remove deleted files
Merge branch 'OL' into dev
Switch to more parallel encoding scheme
Switching to true parallelization for file operations (by obsoleting master.py in favor of tokenizeAndEncodeFiles.py)
.gitignore supports hashes
Removing Ben's RScripts
CreateDatabase now allows strings with backslashes, and does not allow any escaped characters (formfeeds, etc.) in imported metadata
ParseDate.py strips tabs and newlines to keep records from being corrupted
.gitignore adds
changes to CreateDatabase.py
new tokenizing updates
disabling OneClick processes for testing
metadata parsing scripts
Draft to test on History Diss set
Adding test version
Problems uncovered with HistoryDiss Test, and full paralellization using multiprocessing
NYT changes
NYT changes
last changes from first Times machines
Warn instead of die on json parsing errors