St. Margaret's Chapel, the oldest building in the city and castle