PruneEH: Only merge attribute sets when used. No functionality change.