Remove (premature) by-reference optimization in matrix/quaternion