Bosch’s father, Anthonius van Aken (died 1478), acted as artistic adviser to the Illustrious Brotherhood of Our Blessed Lady.
Znano je, da je imel Jan pet sinov, od katerih so bili štirje tudi slikarji.