Harrison's sister Sylvia was married to David Maxwell Fyfe, a lawyer, Conservative politician and judge who was successively the lead British prosecutor at Nuremberg, Home Secretary and Lord Chancellor (head of the English judiciary); after his death she married another Cabinet minister, Lord de la Warr.