Without a down payment, you'll have to pay private mortgage insurance. With the increase in the mortgage payment and the added cost of PMI, a second home may be more costly than you realized. You can cancel PMI after you've made 20% equity in your home. Or you can avoid PMI if you have a 20% down payment.