You're doing great. Now you need some actual exposure, too. Check your phone book or local sporting goods store to find one near you. You don't need any equipment or special clothing, nor do you need a group of people to get started. Also, it's totally fine to go to the course or driving range by yourself.
People do it all the time.
If you're wondering what to wear just make sure it's comfortable, loose enough to move freely and generally appropriate for public places. Most golf facilities frown on tank tops, cut-offs, etc. Use your judgement and see what other people have on. If you are very conservative by nature you could simply go to observe the first time you go to the golf course, but that is a bit extreme. Plus, when you see the ball flying through the air you will probably not be able to resist the temptation to give it a try.