Prevent crash on double PamHandle::end call