The national debt, which is still here although the annual deficit is not), the general treasury must then borrow $1 more from those same private markets.
There is still a national debt but there is not an annual deficit.