You need to close your EIN (Employer Identification Number) with the IRS - this is the number assigned to you and your business by the IRS when forming your company.