Cache the inverse of the canvas transform matrix