You should always provide your customers with either an invoice, receipt, or both. This provides documentation for them to prove their expense to the IRS. In the case of an invoice, the customer will also need to provide proof of payment along with your invoice.