EM should average modes over restarts.