For a cash-out refinance, the FHA will back loans for borrowers with credit scores as low as 500. But credit score requirements will vary by lender, and most lenders require credit scores of 620 or higher.