Those things shouldn't add up to too much more over what you have already paid for the necessities. And, with some effort, you can skimp on some of them. For example, you can make the printed items on a good inkjet printer until you have a little more to spend for the real thing. Or you could forward your domain name to a free host. That would certainly seem to be the case with web development.
Some people dip into their savings to start their firm.
Others work a full-time job for someone else, building their practice in their free hours. It may take time, but determined entrepreneurs can start their firms on shoestring budgets. But if you are going to do this full-time, you are going to eventually need to spend some money on advertising. Banner ads, Yellow Pages, billboards, radio spots, TV airtime, newspaper and magazine ads, are some ways to get your name out. At this point, some outside help may be just what you need to get the ball rolling.