Tackling high-interest debt first is often wise, especially if the interest rate is higher than what you'd earn from savings. However, it's also crucial to build a modest emergency fund to avoid further debt in case of unexpected expenses.