sample-test/fails.sgml: Add 500 word sentence
python/bllipparser/ModelFetcher.py: remove extra space
README.rst: Small citation change
python/bllipparser/RerankerFeatureCorpus: Library for reranker input files

Data structures and utilities to read the format that cvlm (reranker
optimizer) takes as input (sparse feature values associated with each
candidate).
first-stage/PARSE/utils.[Ch]: Add unescapeParens, cleanup findAndReplace
Many additions to SWIG wrapper and Python support code.
API changes:
    RerankingParser.py has many updates including a new Tree
    class. This is a thin layer on top of the SWIG InputTree class with
    more/friendlier methods. RerankingParser also supports associating
    a sentence_id with each sentence like parseIt.

    ThreadManager and thread slot support is dropped. This is because
    threading is not actually stable in BLLIP parser and shouldn't
    be used.

    Deprecated methods (RerankingParser.load_unified_model_dir()) have
    been removed. The get_tokens() methods has been renamed to tokens().

Bugfixes:
    Pretokenized text is now PTB-escaped to avoid crashes.
    Sentences longer than the maximum supported sentence length cause
    exceptions rather than segfaults.

Details:

first-stage/PARSE/swig/wrapper.i: Many changes
    ThreadManager and thread slots: removed
    tokenize(): fix bad variable names (maxTokens is really the expected
        number of tokens), added a version of tokenize() which guesses
        this from the length of the string (assumes English, but no
        functional differences for other languages)
    asNBestList(): add sentence ID parameter
    add ptbEscape(), ptbUnescape()
    InputTree: add getTags(), getWords() methods

first-stage/PARSE/swig/*/test/*: updated to remove ThreadManager,
    test sentence_id

first-stage/PARSE/ThreadManager.[Ch]: removed

first-stage/PARSE/Makefile: add clang leak detection target,
    remove ThreadManager support

python/bllipparser/RerankingParser.py: Many changes
    Add Tree class, remove ThreadManager support
    ScoredParse: better docs
    Sentence: remove max_sentence_length since it's misleading,
        get_tokens() -> tokens(), add __len__(), pretokenized text is
        ptbEscaped to avoid crashes
    NBestList: add optional sentence_id, get_tokens() -> tokens(),
    RerankingParser: add sentence_id parameters, simple_parse(),
        and tag() methods, remove deprecated load_unified_model_dir(),
        add parser_only option to from_unified_model_dir()

python/bllipparser/ParsingShell.py: get_tokens() -> tokens()

python/bllipparser/__init__.py: updated docs, add some metadata fields

README-python.rst: updated to cover new methods and Tree class

setup.py: smarter about when to rerun swig, pull in docs from
    README-python.rst to avoid some doc duplication, remove ThreadManager
python/bllipparser/ParsingShell.py: toStringPrettyPrint() is now pretty_string()
first-stage/TRAIN/README: add rough training procedure

Also some cleanups.
Makefile: fix SParseval download URL
Python READMEs: fix docs for load_reranker_model
nltk.tree.Tree.parse has apparently been removed/replaced by fromstring. There is bracket_parse too but it says don't use it.
Tweak so that ParsingShell should with newer and older NLTK.
Merge pull request #23 from jimwhite/BLLIP_MASTER

NLTK API tweakage.
first-stage/PARSE/parseIt.C: -N, -E help updates
first-stage/README.rst: Convert to RST, updated
first-stage/README.rst: Sections -> numbers
Also some minor tweaks.
first-stage/DATA/EN: remove old cruft
first-stage/TRAIN/README.rst: RSTified, updated
first-stage/PARSE/parseIt.C: Fix README path
README.rst: fix paths, Sparseval URL, citations