Fix panning breaking click and drag