The last recorded Olympic games were held in 393, and many temples were destroyed or damaged in the century that followed