Avoid spurious memory consumption when computing Viterbi/posteriors
compute posterior output in each shard for potential speed up
compute output in each shard
better Viterbi/posterior output
projection computation is optimized (TODO: verify this, and implement for Model4...?)