Generally, you should have a minimum of $50 million or more to start one family office. However, family offices offer advice to families with assets starting at $20 million.