What happens is that the serial connection of the glow lamp clamps the circuit even when you turn the switch off. This, in turn, causes a low voltage drop to appear to the LED driver, and as a result, the LED bulb glows weakly. We suggest that you ask an electrician to look at your wiring in your home.