convert RtGroupRemoveList to Set of RtGroup *