Only update those patches of the terrain that have changed