The rising interest bill is already contributing to a gaping annual hole in the books.