A cold bathroom is likely caused by drafty windows or a lack of heating. Exhaust fans can also lead to a cold bathroom, as the fans lead to warm air being lost and replaced by cold outside air.