Whether you should pay off big debt or small debt first depends on your psychological makeup, like whether or not paying off small debts will inspire you to stay on a repayment program. However, paying off big debt is more cost-efficient in the long run. The larger your outstanding balance, the more interest you end up paying. So, by settling the big debt, you will save on interest, and you will free up funds for other bills and other purposes.