Remove the list of sub issue if empty.