A 3.5% down payment is the lowest an FHA loan will allow, but you can always put more down if you want to. If you have a score that's below 580, you'll need to put at least 10% down to qualify for an FHA loan.