A bookkeeper’s job is to keep your financial records in order. A bookkeeper will maintain your general ledger, keep track of financial transactions, and produce financial reports. A CPA can help your small business prepare tax returns, conduct audits, and provide financial consultation.