A wine cellar should ideally maintain a temperature between 45°F and 65°F for optimal wine preservation.