Fix setting player color in pvp mode

kudos to @smikosch for finding the issue