If we get here from line 419 or 421 (the ncolgroups code), don't we need to call remove twice?