Remove a map from dofmap construction.