remove sets if they empty out