Japan does get busier during the kōyō season, but it is not as crowded as during the cherry blossom season. From my point of view, the best time to visit Japan is during October and early November. During this period, there are fewer crowds, temperatures are comfortably mild, and places are generally less busy.