Wingfield was the ancestral home of the Wingfield and De La Pole families. Michael De La Pole, Earl of Suffolk, built the castle in 1384.