Although the EIN will always be tied to your business, you can close your business account with the IRS by following the Closing Your Account procedure.