Fix coordinate grids hijacking mouse scroll

This mostly fixes #427. Now the mouse scroll hijacking issue will only occur if you disable zoom after it was previously enabled. Still looking for a more elegant solution, but wanted to submit a fix ASAP since #427 is a regression.