Fix a few minor issues with lobby behaivor

- Allow users to leave the lobby
- Fixed lobby-leave buttons (hacky, but w/e)
- Fixed lobby members persisting on the frontend even after quit
- Give some reactability when an error occurs on inviting a friend
- Fixed possible issue in lobby remove user code