And the Labyrinth is where the Charm would be otherwise very useful to check the HP of the stronger enemies to know how much is left for their defeat.
The earlier reward of getting a bottle full of Great Fairy's Tears seems much better.