Revert three commits relating to shadow assets (such as image varieties) in the asset map.
Not possible to make SM#3180 fully work without Matrix changes, so pushing these off the dev mainline and into a branch instead.