Organized logic for when N_SPECTATE messages are ignored. Ensured that the groups get cleared when players reset.