Most of these can be found at your friendly neighborhood surfshop. A used board is generally your best bet when starting out. Chances are good that you're going to ding it up just carrying it around. See the upcoming FAQ on wetsuits for recommendations. You can usually wheedle the wax out of the surfshop owner if you buy anything there.
Some surfers pride themselves on never having bought a bar of wax.
Find someone good to teach you to surf. Find someone else who wants to learn and teach each other. I subscribe to the second approach. Probably because that's how I learned and because when one person is better than the other someone is probably not having a very fun session. Don't get me wrong, I really enjoy teaching people.