test 3x3 determinant