Yes, jitter can significantly affect the sound. It causes distortion that can appear as noise, blurring or loss of dynamics. A higher jitter value usually leads to more severe sound distortion.