Historians primarily rely on written sources, such as documents, letters, and diaries, but they also explore other forms of evidence, including archaeological findings, oral histories, and visual materials, to gain a comprehensive understanding of the past.