Really only do an input poll every vblank (and only once a vblank)