Yes! I actually failed to get the rail pass before I went, and was slumming it on overnight buses and local trains to recover the cost.
If you plan on traveling to more than a couple of locations, the rail pass is definitely worth the investment, and much cheaper than buying individual tickets in Japan.