Yes, you can get sick if you do not refrigerate your yogurt. If it is left out for longer than two hours you should not eat it. Bacteria start to grow which will make you sick. The severity is different for everyone but can range from a stomach ache to food poisoning. It's best to make sure that you keep yogurt refrigerated.