Robust mechanism for keeping the gameplay sane when players leave