Dunkleman quit thereafter, making Seacrest the sole emcee of the show starting with season two