I just tested this and it works.  A site admin can still administer the group, when the group has no admins.