Yes, you should italicize the name of a musical in your writing for clarity and proper formatting.