The speaker disagrees with the notion of planting rye too early in mid-August, stating that it is necessary to have rye and oats in the mix to provide a green food source for deer, especially in areas with limited food options.