With a conventional loan, you may have to pay private mortgage insurance (PMI) if you put less than 20% down on the home. Also, they tend to have higher interest rates than government-backed loans like FHA loans. So, you might end up paying more in interest with a conventional loan.