Changed the shifting to only be done when there are more than 4 people
in the game.