Optimization is dangerous because if transforms changed the transformation should not be skipped. Instead, avoid recomputing axes patch every time a grid line is added.