In general, you do not need a certificate of good standing to start and operate your business. However, you will likely need a letter of good standing for specific business purposes, such as to open a business bank account, apply for a business loan or transfer ownership of your business.
Furthermore, some states may require a certificate of good standing for certain business licenses and permits. For example, you must have a valid certificate of good standing to obtain a liquor license in Rhode Island.