Borrowers with a credit score as low as 500 can apply for an FHA loan provided they can make a 10% down payment, whereas those with credit scores of 580 or higher are allowed to pay as little as 3.5% toward the down payment.