You can wash your windows in the winter, but experts advise only when temperatures are above freezing. Adding rubbing alcohol or windshield cleaner to your cleaning solution can prevent the solution from freezing. No matter the season, it’s always better to wash your windows on an overcast day or early morning. When glass is in direct sunlight, the cleaning solution can evaporate and leave streaks on the window.