New document annotator that can concatenate hyphenated tokens if they represent a single word
now works in place. name changed to dehyphenator
dehyphenator is now dehyphenating tokenizer since it itself tokenizes the document instead of taking as input a pre-tokenized doc
app.nlp.mention: fixing bug in parse based mention finding
app.nlp.lemma: fixing lower case lemmatizer to be consistent with its attributes
app.nlp.coref: fixing coref bug
app.nlp.parse: adding an explicit bias to TransitionBasedParser (this should not break serialization, but testing is advised before merging)
changed sentence segmenter to not have an assertion that sentenceStart != sentenceEnd, but to only add a sentence if this condition is true. This addresses run time crashes I was getting
Merge pull request #92 from alextp/add-bias-to-parser

app.nlp.parse: adding an explicit bias to TransitionBasedParser (this sh...
app.nlp.ner: name change from StackedNER to StackedChainNerTrainer in HyperparameterOptimizer
util: removed stray hyphen in sh/log files generated by HyperparameterSearcher
app.nlp.parse: fixed behavior in TransitionBasedParserTrainer when user passes both single file and whole-directory train/test data (now uses all of it)
app.nlp.parse.ProjectiveGraphBasedParser: train method and command line params for reading training/testing files from directories
app.nlp.load.LoadOntonotes5: was loading auto dependency labels/heads instead of gold
README: fixing command line options for fac
app.nlp.segment.DeterministicSentenceSegmenter: fixed NoSuchElementException in the case that the first sentence in a segment ends with a token that ends with '.'
tentative name changes to some type params/methods/traits in the classifier framework
fix compile error and change LinearModel -> OptimizablePredictionModel
fix a typo in feature generation.
Merge pull request #97 from cllu/master

fix a typo in feature generation for mention entity type.