Fix occasional teleport on refocus