Yes! Face masks were enough of an obstacle to using Apple Face ID, and adding glasses to the mix only complicates things. However, it's easy to get past this:
Head to "Settings -> Face ID & Passcode." Click on the "Add Glasses" option located under "Face ID with a Mask." Put on your glasses and proceed with the on-screen instructions. The iPhone will scan your bespectacled face. Once you set everything up, you'll be able to unlock your iPhone while wearing a pair of glasses.
Of course, the "Add Glasses" option appears as soon as you set up Face ID; you don't need to enable the face mask setting to use this feature.