Fix the SparsityMap type to work with MixedMaps