If you're not renting a car or campervan, buses are one of the best ways for travelling New Zealand. Trains are also good if a little more expensive, and hitchhiking is much cheaper although less reliable.