Replacing all of your windows can be a costly project since energy-efficient windows are more expensive. You can expect to pay around $300-$1,000 per window plus labor costs. However, you will save money on your energy bills over time, so this amount should also be factored into the overall cost.