Yes, non-citizens can start a business in the US, even without residency. It's common for foreign nationals to set up US businesses, both big and small, to access the US marketplace and achieve success.