By installing replacement windows first, you'll prevent the potential damage to your new siding later. Also, when contractors install the siding there is a risk of damage to the metal caps on your window frames. Most contractors will simply replace the damaged metal caps when finished installing the replacement siding.