Signs that You May Be Subject to an IRS Investigation. (1) An IRS agent abruptly stops pursuing you after he has been requesting you to pay your IRS tax debt, and now does not return your calls (2) An IRS agent has been auditing you and now disappears for days or even weeks at a time.