Removed old test programs
Reused StringBuilder in DocIndexerAbstract
Slight changes to ComplexField.

- added getProperties()
- made addProperty return a ComplexFieldProperty
- stored mainProperty object instead of name
Improvements to punctuation filtering in StringUtil

- Simplified/sped up removePunctuation()
- Added trimWhitespaceAndPunctuation()
Eliminated prepConcForDisplay() method
Added getTotalUniqueTerms() to LuceneUtil
Added has/setForwardIndex() to ComplexFieldProperty
Added the ability to pass parameters to DocIndexers.

This will be used to configure DocIndexers (if necessary) through
commandline switches and/or property files.
Fixed occasional crash bug in SpansNot.skipTo().

This method would sometimes throw a NullPointerException when searching
for "any token" ([]).