It turns out, the answer is yes - in most cases, it is mandatory to charge tax on subscription fees.
For any business with nexus in the United States, whatever they are selling is subject to sales or use taxes unless it falls into an exception category. Sales tax applies in every state where you have nexus.