Basing their hypothesis on guesswork alone is one of the most common mistakes that people make while A/B Testing. Or sometimes, they start out without a concrete hypothesis at all. People also collect incorrect samples a lot of the time. Either they choose too little a timespan or too large. Sample pollution is something that you MUST avoid while A/B Testing.