The butterfly stroke is definitely the hardest. Still, you shouldn't center your workout around this stroke; instead, try swimming a simpler stroke (like freestyle) at a harder pace.