You must keep employee W-4 forms in your records for four years to verify that you are withholding federal income taxes correctly. These forms, along with other forms signed by employees, must be available in hard copy format in case the IRS requests it.