Question: why are doped semiconductors neutral?
Answer: The reason why your doped semiconductor carries a neutral charge is because it has equal number of electrons as there are protons, be it boron doped or phosphorous doped. While the whole crystal remains neutral, by doping you are vastly increasing the conductivity of the semiconductor.