Optimize sorting block.

Since we know we can never be < 0 because we're sorting an indices
array, we can go directly to .at_pos.