Some common mistakes to avoid when starting an agency in 2023 include not having a clear business plan, underestimating the importance of marketing and branding, not having a solid financial plan, and not investing in the right technology and tools.