Not necessarily. Here's a good article on the subject. I try to buy my tomatoes at the farmer's market, avoid refrigerating them, and use them within a day or two. But if I plan on storing them for longer, I do refrigerate them. I always remove refrigerated tomatoes from the fridge 1-2 hours in advance, to allow them to get to room temperature.