Ávila, Spain
He was the illegitimate and first son of Don Fernando Álvarez de Toledo, 3rd Duke of Alba, "The Iron Duke", who fathered Fernando de Toledo upon the daughter of a miller of La Aldehuela, in the province of Ávila, Spain.