flexible offset in hmmaligner
server now tracks detonization and such and reports tokens as character spans
less debug output
server now includes tokenization info by default.

Also added support for nbest