Scientists rely on various sources of evidence, including sedimentary rock layers, fossils, and geological formations, to infer what happened during different time periods. They also use techniques like carbon dating and fossil analysis to gather information about past life forms.