You'll need a credit score of at least 500 in order to qualify for an FHA loan. However, to qualify for the lowest down payment, you’ll need a score of at least 580.