Make sure the user can't remove geometry parts while in the process of adding a geometry part