Unfortunately, the answer is yes. It damages the paint eventually anyway. White spirit is a petroleum based solvent, this is why it is so effective at removing paint, but since it is highly volatile and toxic, it shouldn't come into contact with the paint at all. In fact it doesn't even have to come into contact with the paint to do damage. The volatile solvents will evaporate and will then cause a chemical reaction in the paint film and this can cause it to deteriorate over time. The paint will usually turn white and brittle, this is due to the paint drying out.