Fix upwards go to line motion in visual mode (#241)

Looks pretty hacky but seems to do the trick. Any improvements wildly
welcome.