Allow removal of empty categories