Revert client colours to their preferred colours after the map is changed

Fixes #2497

This might need to be tested with some other people in the lobby.