Add back the unbindKeyboardEvents on remove()

The undelegateEvents method doesn't get invoked on remove(), so we
actually need the hook in both places.