Bookkeeping, dog walking, house sitting, snow removal, fact-checking, tutoring, and resume writing are all businesses you can start with little (or no) money. In most cases, all you need is a website and some hustle, making them extremely low cost.. You can definitely start a business with little or no money upfront.