Yes, they are heavily dependent on sample size. You need right sample size in order to finish the test and draw conclusion from the test results. This sample size criteria usually mean you need to run A/B test for several weeks. That also means you need a high traffic website.