To keep yourself safe from bacterial growth or spoilage, you should only keep cheese out for four hours, according to Adam Brock, director of food safety, quality, and regulatory compliance at Dairy Farmers of Wisconsin.