To explore the changes in the cerebral microstructure of patients with noise-induced hearing loss (NIHL) using diffusion tensor imaging (DTI). Overall, 122 patients with NIHL (mild [MP, n = 79], relatively severe patients [including moderate and severe; RSP, n = 32], and undetermined [lost to follow-up, n = 11]) and 84 healthy controls (HCs) were enrolled. All clinical data, including age, education level, hearing threshold, occupation type, noise exposure time, and some scale scores (including the Mini-Mental State Examination [MMSE], tinnitus handicap inventory [THI], and Hamilton Anxiety Scale [HAMA]), were collected and analyzed. All participants underwent T1WI3DFSPGR and DTI, and tract-based spatial statistics and region of interest (ROI) analysis were used for assessment. The final sample included 71 MP, 28 RSP, and 75 HCs. The HAMA scores of the three groups were significantly different (p < .05). The noise exposure times, hearing thresholds, and HAMA scores of the MP and RSP were significantly different (p < .05). The noise exposure time was positively correlated with the hearing threshold and negatively correlated with the HAMA scores (p < .05), whereas the THI scores were positively correlated with the hearing threshold (p < .05). DTI analysis showed that all DTI parameters (fractional anisotropy [FA], axial diffusivity [AD], mean diffusivity [MD], and radial diffusivity [RD]) were significantly different in the left inferior longitudinal fasciculus (ILF) and left inferior fronto-occipital fasciculus (IFOF) for the three groups (p < .05). In addition, the FA values were significantly lower in the bilateral corticospinal tract (CST), right fronto-pontine tract (FPT), right forceps major, left superior longitudinal fasciculus (temporal part) (SLF), and left cingulum (hippocampus) (C-H) of the MP and RSP than in those of the HCs (p < .05); the AD values showed diverse changes in the bilateral CST, left IFOF, right anterior thalamic radiation, right external capsule (EC), right SLF, and right superior cerebellar peduncle (SCP) of the MP and RSP relative to those of the HC (p < .05). However, there were no significant differences among the bilateral auditory cortex ROIs of the three groups (p > .05). There was a significant negative correlation between the FA and HAMA scores for the left IFOF/ILF, right FPT, left SLF, and left C-H for the three groups (p < .05). There was a significant positive correlation between the AD and HAMA scores for the left IFOF/ILF and right EC of the three groups (p < .05). There were significantly positive correlations between the RD/MD and HAMA scores in the left IFOF/ILF of the three groups (p < .05). There was a significant negative correlation between the AD in the right SCP and noise exposure time of the MP and RSP groups (p < .05). The AD, MD, and RD in the left ROI were significantly positively correlated with hearing threshold in the MP and RSP groups (p < .05), whereas FA in the right ROI was significantly positively correlated with the HAMA scores for the three groups (p < .05). The changes in the white matter (WM) microstructure may be related to hearing loss caused by noise exposure, and the WM structural abnormalities in patients with NIHL were mainly located in the syndesmotic fibers of the temporooccipital region, which affected the auditory and language pathways. This confirmed that the auditory pathways have abnormal structural connectivity in patients with NIHL.