When performed correctly, background noise removal should not significantly affect the quality of the main audio. Modern noise removal tools are designed to minimize any distortion or artifacts while targeting only the unwanted noise frequencies.