Technically you do not have to replace all your windows at once. However, the best way to maximize your energy savings is to replace all old windows at the same time to eliminate all drafts at once. Read more.