It all depends on what type of remover you are using, for some of them are gentle enough and will cause no damage, while others are stronger and may damage the fibers and the dye of your fabric. Make sure to always read and follow the product directions.