Yes, it's advisable to open the bathroom windows during reglazing if possible. Proper ventilation helps disperse fumes and odors more quickly, especially when combined with fans or ventilation systems.