Private debt collectors can’t directly claim tax refunds from the IRS. Only federal and state agencies can garnish refunds for specific debts.