If you default on your holiday loan, you could damage your credit score and incur additional fees and penalties. Some lenders charge high interest rates and fees when taking out a personal loan for vacation expenses, which can make it more expensive than other options like using a credit card or savings.