By 1801, Madison's slave population at Montpelier was slightly over 100. During the 1820s and 1830s, Madison was forced by debts to sell land and slaves. In 1836, at the time of Madison's death, he owned 36 taxable slaves. Madison did not free any of his slaves either during his lifetime or in his will.