Ampersands aren't allowed on GOV.UK - this includes department names. Historically, some like DWP and FCO have ampersands in their branding and this has been retained only in their logo image. So it's not if it's part of a department's brand, it's only if it's in their logo image. Equally, commas have been removed from department names in Defra and BIS.