Dealing with frozen windshield on your car can be frustrating, but you should not pour warm or hot water on the glass. The extreme change in temperature will cause the windshield to shatter or crack.