madoz mentions it as the ruins of an old castle that dominated the population