Kastoria is believed to have ancient origins. Livy (XXXI, XL) mentions a town near a lake in Orestis, called Celetrum, whose inhabitants surrendered to Sulpitius during the Roman war against Philip V of Macedon (200 BC). The ancient town was possibly located on a hill above the town's current location.