A major downside of cross-collateralized loans is that once a borrower has multiple sources of debt through the same lender that are cross-collateral loans, it can be difficult to move them to another lender. Paying off the loan is usually the best option for getting out of this type of loan.