That means the oil wasn't hot enough. Don't worry, you can fix this. Just transfer the entire mixture—oil and aromatics—to a small frying pan over medium-ish heat. Cook the aromatics in the oil until the garlic just starts to turn golden, then take off the heat.