Borrowers between 35-49 have the most debt, totaling nearly $636 billion.