You can tell if your garlic infused chili oil is turning bad if you see changes in color, scent, clarity, or any mildew growing. If any signs show, it’s time to toss it.