No, a residence permit is not mandatory to start a company in Latvia. However, having a residence permit may simplify some aspects of business and provide a stable status in the country. You can also consider company registration in FEZ for more benefits.