Don't skimp on your Internet Service Provider. A good provider will also give you redundant fast connections to the Internet. Either hire a professional to design your site or spend some time learning HTML or site design. Tools like Microsoft FrontPage and NetObjects Fusion shield you from the actual HTML and make the process more like word-processing or desktop publishing. Decide how much money you want to spend in order to get a return on your investment.
People create websites for almost no money and others spend thousands of dollars.
Get your site listed with as many search engines and other sites as you can. A simple interface allows easy submissions to multiple sites. Offer something of genuine value. This can be as simple as a set of links which allow visitors to find helpful information that they might be looking for on your site. Don't expect to be an overnight success.