fix remove issue when set is empty