Changes:
eval_bracket.py is added to evaluate bracket performance for a parsing
tree
retag.py: New option othertagstrategy is introduced to modify internal
nodes of a parsing tree. SIMPLE strategy simply replaces all nodes with
a X symbol.
Also --preterminaltagfile (previously tagfile) is made optional.
split.py: Files generated by split.py also includes maximum sentence
length in file names as l<maxlength>
upos_map.py: tag remapping is guaranteed not to fail in case that there
is no matching tag for a given word. Instead a special tag symbol _RARE_
is used (This is usually the case for metatags in penntreebank.)