Reduce usage of splatting, and use @inbounds

Particularly the splatting change leads to a major (as much as 10x)
performance enhancement, and is finally allocation free!