Lenders view second houses as riskier, whether they are holiday homes or investment property. Minimum credit score criteria are often greater, and maximum debt-to-income ratios are lower than for a principal dwelling.