According to the IRS publications, all-expense records and reports should be kept for a period of 3-7years, although some records should be kept longer than just seven years. For this reason, a physical receipt should be presented for all business expenses that are paid in cash. This is important for tax filing purposes, and it may be required for potential audits by the IRS.