During the later years of the Roman Empire, the Germanic peoples of northern Europe grew in strength and repeated attacks led to the Fall of the Western Roman Empire in AD 476, a date which traditionally marks the end of the classical period and the start of the Middle Ages .