(what I mean is that calling ``with_spectral_unit`` is a waste of time because astropy.wcs will fix it back when you create the new WCS, and the only useful thing to come out of it is that ``_secptral_unit`` gets set, so you could just fix that directly.