It takes money to support. The interest you pay is a regular, ongoing expense. The same is true in small business. When you borrow money, you must pay interest regularly. Usually a good chunk of interest.
Interest becomes a fixed-period cost, just like any other overhead cost.
Smart small business owners usually try to minimize overhead when they begin a new business. Of course, borrowing money is one way to have money to invest in these things. But, unlike starting a business with your own money, once a loan is taken, tick-tock starts the interest clock. If the new business doesn't generate repayment of the loan quickly, you have just taken on another fixed expense. Having fixed expenses means you must generate revenue sufficient to cover these fixed expenses.