You definitely don't have to, but this is one of those dishes that gets better as the flavors meld. Letting it chill in the refrigerator for 30 minutes just makes it that much better. You can even make it a day ahead and store it, covered, in the fridge until serving time.