Improve precision of polygon model hit by calculating inverse matrix

There are complex arguments to formulate inverse matrix, which I won't
discuss here.  But it looks better when the face is not coplaner when
the face has 4 vertices.