Guernsey and the other Channel Islands represent the last remnants of the medieval Dukedom of Normandy , which held sway in both France and England .