While swirl marks don't damage your car's paintwork, they can detract from its appearance, especially on dark-colored cars. If aesthetics are important to you, it's worth addressing swirl marks.