The village can later be returned to via time hole.
Outside the time hole to Hollijolli Village, a Toad lies near-unconscious, muttering about having been attacked by a huge monster through the time hole.