The Crawleys family characters are based on the Earls and Countesses of Carnarvon, who reside at Highclere Castle. The series was filmed there. However, the fictional Downton Abbey is in Yorkshire, not Hampshire, where Highclere is.