* Fix memory leak in beam
* Hacking on lattice stuff. Parser working in 1-lattice mode, with most things wired up for wider lattices, except the POS tagging.
* Fix tagger bug
* Mix string probabilities into beam, taking care to avoid the need for a look-ahead probability.
* Clean up stray comments from sentence
* Fix string probabilities -- to avoid the need for a lookahead, just take the average through the path. This might be bad.
* Prepare transitions for lattice-aware oracle, and delete parameter cruft
* Remove assertion that p > 0, since we're averaging now
* Add exceptions to word lookup in index
* Change signature on validate transition functions
* Add lattice data munging script
* Lattice training, but there's a memory bug somewhere...
* Hackishly fix memory error. Should replace this with a vector.
* Change string_prob, so that it just stores the last shift probability, for use in features
* Add string probability features
* Normalize lattice steps
* Fix bug in n0_prob, and add a value to logprob features for p=1
* Add special mechanism for distinct shift classes, so that we can have the classifier give a distinct probability to shifting the top word from the lattice.
* Fix state header. This should belong to an earlier commit.
* Give tokens from the top of the lattice, to compute a baseline wer