Group handling and bookkeeping

Fixed so that changing groups works as it should, and that we get a good
cleanup when a user leaves. I'm sure theres more, ah, I added more on
the scoreboard for the gamemaster.