Berry Pomeroy Castle Berry Pomeroy Castle , a Tudor mansion within the walls of an earlier castle , is near the village of Berry Pomeroy , in South Devon , England . It was built in the late 15th century by the Pomeroy family which had held the land since the 11th century . By 1547 the family was in financial difficulties and sold the lands to Edward Seymour , 1st Duke of Somerset . Apart from a short period of forfeit to the Crown after Edward ' s execution , the castle has remained in the Seymour family ever since , although it was abandoned in the late 17th century when the fourth baronet moved to Wiltshire . After lying in ruins for a hundred years , in the 19th century the castle became celebrated as an example of the " picturesque " , and it became a popular tourist attraction , a status which it retains today — aided by its reputation of being haunted . Between 1980 and 1996 the castle was subjected to extensive archaeological excavations that clarified much of its history and overturned previously held beliefs regarding its age and cause of destruction . Location . Berry Pomeroy Castle is located about a mile north - east of the village of Berry Pomeroy in South Devon . It occupies a limestone outcrop that overlooks the deep , wooded , narrow valley of the Gatcombe Brook . History . The Pomeroys . The de la Pomeroy family held the large feudal barony of Berry Pomeroy from shortly after the Norman conquest of England , as the Domesday Book of 1086 records . Early documents refer to a " capital messuage " at Berry , signifying the " caput " of the manor , which manor in turn was the " caput " of the barony , which consisted in 1166 of almost 32 knight ' s fee s , each equating approximately to a single manor . Although Henry Pomeroy enclosed a deer park here in 1207 , the first reference to a castle does not appear until 1496 , when Elizabeth , widow of Richard Pomeroy , was assigned a third of both the castle and the capital messuage . The document makes it clear that these were on different sites ; the messuage is now thought to have been on or near the site of Berry House in the nearby village . Archaeological evidence , and particularly the design of the gun port s in the gatehouse and St . Margaret ' s Tower , which together with the curtain wall are the oldest parts of the castle , indicate that the castle was probably built in the late 15th century . It would have been one of the last traditional personal castles to be built in the country , located on a favoured site within the Pomeroy ' s deer park . Under the Pomeroys the castle consisted of a dry moat ( now mostly infilled ) , gatehouse and ramparts surmounted by the curtain wall with buildings disposed around the wall on the inside . Due to the extensive remodelling that took place later , very few archaeological remains survive to show the exact placement of these original buildings . In 1978 , a wall painting was discovered in the upper storey of the gatehouse , hidden behind a thick layer of vegetation . It is a representation of the Adoration of the Magi and has been dated to c . 1490 – 1500 based on its stylistic similarity to European works of the period . The Seymours . In 1547 Edward Seymour , 1st Duke of Somerset , Lord Protector to the young King Edward VI , bought the castle from Sir Thomas Pomeroy . He bought many other properties at around this time , and may never have visited Berry Pomeroy . He fell out of favour with the court and was beheaded on a charge of treason in 1552 , upon which all his lands were forfeit to the Crown . It was not until 1558 , after complex property dealings , that his son by his first marriage , Sir Edward Seymour , gained title to the castle . He became a considerable landowner , High Sheriff of Devon in 1583 and a Justice of the Peace in 1591 . Between 1560 and 1580 he removed the earlier Pomeroy buildings inside the castle walls and erected a new four - storey house in the fashionable style of the period at the north end of the courtyard , the shell of which survives mostly to its original height . After Sir Edward ' s death in 1593 , his lands passed to his son , another Edward , who added the North Range to the castle in about 1600 . In the late 16th century there was concern at the threat of a Spanish invasion and he received a commission as Colonel and he was twice Sheriff for Devon . He died in 1613 , two years after being created a baronet . There is a well - preserved monument to him in Berry Pomeroy Church . Sir Edward Seymour , 2nd Baronet , his son , was Governor of Dartmouth and a member of parliament and was knighted in 1603 . He was much involved in shipping and lived in style at the castle until the Civil War , when he sided with the Royalists . He was captured and while he was imprisoned in London the castle was raided by Parliamentarians . His estates were sequestered by Cromwell , but he was allowed to stay at the castle , where he died in 1659 . His son , another Edward ( later the 3rd Baronet ) , was also a Royalist and was appointed a colonel in 1642 . In the latter part of the Civil War he was imprisoned in Exeter and was not released until 1655 . After the Restoration in 1660 , however , his life took a turn for the better and he was soon a Deputy Lieutenant for Devon . He later became a Vice - Admiral and member of parliament for Totnes . On his death in 1688 an inventory of the castle was drawn up . It indicates that the house then contained around fifty rooms , although it is likely that the buildings were in poor repair , due to the vast expense Seymour had incurred in the Royalist cause . His son , Edward , 4th Baronet , was aged 55 when his father died , and was an earnest politician – he was member of parliament for Exeter and from 1673 Speaker of the House of Commons . Because of Berry Pomeroy ' s distance from London and the poor condition of the castle , he preferred to live at Bradley House in Maiden Bradley , Wiltshire , which he had also inherited . Although there is no documentary evidence , it is likely that he stripped the castle of useful materials to fund the rebuilding of Bradley House which he completed in 1710 . Certainly , Berry Pomeroy Castle was a ruin by 1701 when John Prince , who had known the castle in its heyday , said in his book " The Worthies of Devon " : . . . The apartments within were very splendid ; especially the dining room , which was adorn ' d , besides paint , with statues and figures cut in alabaster [ . . . ] ' tis now demolished , and all this glory lieth in the dust . . . 19th century . With the rise of the " picturesque " aesthetic at the end of the 18th century , the castle , by then the haunt of jackdaws and overgrown with ivy , was considered to be a romantic ruin . It was often visited by artists and became a popular tourist destination : illustrations of it were featured in many books of the genre . The J . V . Somers Cocks catalogue of Devon Topographical Prints lists 45 prints of the castle , from the earliest by Samuel and Nathaniel Buck , published in London in 1734 , to one published in Exeter in 1861 . In around 1830 some of the crumbling walls were repaired by the Duke of Somerset , one of the first examples of architectural conservation work on a ruined building , probably prompted by concern over the safety of visitors . Late 20th century excavations . Between 1980 and 1996 the castle was subjected to extensive archaeological excavations , fully documented in the 1996 volume of Devon Archaeological Society Proceedings . These investigations clarified much of the castle ' s history and overturned a number of previously held beliefs . For instance it had been believed that the castle was much older than it has now been shown to be : a guidebook of around 1940 stated that " All the portions of the ruins of Berry Castle encircling the interior were indisputably the work of that de Pomeroy on whom the Conqueror bestowed the manor after his invasion of England in 1066 " . However , the excavations found no trace of buildings earlier than the late 15th century and only five sherds of late medieval pottery were found , leading to the conclusion that there could not have been anything more substantial than a hunting lodge or park - keeper ' s house on the site before the late 15th century construction of the castle . Commonly held beliefs regarding the destruction of the castle were that it was bombarded by cannon fire from the hillside opposite during the Civil War , or that it was destroyed by a huge fire after being struck by lightning . The excavations uncovered no indication of either of these supposed fates , but did show evidence that the buildings were systematically stripped of re - usable materials shortly after demolition . Legends and ghosts . There are a number of legends associated with the castle , and according to the English Heritage guidebook , it " is reputed to be one of the most haunted castles in Britain . " Two female ghosts are said to haunt the castle : the White Lady , and the Blue Lady . The Blue Lady is said to beckon for help from passers - by , luring them to her tower . If they go to her , it is said they fall to their death . She is thought to have been the daughter of a Norman lord and is said to wander the dungeons mourning the loss of her baby , which she murdered as it was sired by her own father . The White Lady , said to be the spirit of Margaret Pomeroy , is claimed to haunt the dungeons , having been imprisoned there by her sister , Eleanor , who was jealous of her beauty . Their stories often blur together . Today . Today the castle is a Grade I listed building . It is still owned by the Duke of Somerset , though it is administered by English Heritage . The castle is approached by a modern half - mile long wooded drive that runs alongside the original drive which is visible as an earthwork in the adjacent woods . The main carpark is in the quarry that was the source of much of the slate used for the Pomeroy buildings .