SEO Brighton recommends carrying out any conversion optimization tests for 2 months and advises that you should ideally like to have at least 5 conversions in each test. However, this may be difficult to achieve.
Short tests can lead to misleading results. For example, if an A/B test only ran for 1 week and showed a positive result, it would be difficult to determine whether that result would hold up over the long term.