Conventional wisdom says you’ll need 20% to refinance with a conventional loan, but in fact, you’ll only need 20% if you want to avoid paying mortgage insurance or plan to do a cash-out refinance.