bugfix vec3.transformMat3, quat.setAxes, quat.fromMat3

also, many more tests, and fixed some erroneous tests which were
how the bugs got started.