With proper cleaning techniques and using appropriate materials, you shouldn't worry about damaging your windows. Avoid using abrasive materials that could scratch the glass or frames.