Why does the follower need to ensure a prepare with a higher epoch is from the same leader?

Will this mean that a new leader can never get elected without the actual old one failing and all the current followers going back to probe state first?