Yes. You can delete invoices, recurring invoices, expense records, clients and quotes. Any of your data can be deleted permanently by you at any time, and closing your account will also delete all of it permanently.