His sons Sir Charles FitzRoy (1796–1858), governor of New South Wales, and Robert FitzRoy, the hydrographer, were notable for their achievements.
Его сыновья сэр Чарльз ФицРой (1796—1858), губернатор Нового Южного Уэльса и Роберт ФицРой.