No, wine cellars do not necessarily need to be underground. They can be located in a cool, dark place that provides stability in temperature and humidity, regardless of whether it is underground or not.