TTT: Possible fix for player colors resetting

Getting reports of colors resetting when round starts. Can't reproduce
it, but this may help.