Yes, you can. It will depend on where you want to build it, so do your research. They don't have HOA fees and are easy to manage, which makes them great investments.
It is easier to afford because you can buy one with an FHA loan.