Yes, it is mandatory to include GSTIN on all invoices issued by a taxpayer. Additionally, the GST registration certificate must be displayed at all business locations.