Properly restore margins on go_to_page

This should fix #272. See discussion there.