You don't have to but you can. If you add dry orzo to the soup, it'll get supersized in leftover portions overnight. I find it makes the soup that much more hearty, with one-half cup of orzo not completely taking over the leftovers. If you don't like the orzo "growing" so large you can boil it separately and add it to the soup once cooked.