1. Added all kinds of db constraints, and am addiing the ability to toggle them off for mass importation.
2. As a preprocessing step, rewrite the MediaWiki markup of documents to plain text and stip out some additional metadata. This is currently performed as a two-fold operation: first convert it to HTML and them to plain text. I plan to write a custom parser which will alleviate the need for the intermediary HTML representation.
3. Made the processing of documents concurrent.  All my cores are used, now.
4. Made a lot of changes really fast to get as much done as possible before the week ended, and broke the specs in the process. I will clean those up next week.