No, you should not leave a bottle warmer on all night. Many bottle warmers heat water with steam. This may be a fire hazard if the water evaporates and the bottle warmer is not shut off.