This can happen with abrupt temperature changes while you're cooking. It's hard to be patient when you're monitoring the candy cooking for up to an hour, but don't adjust the burner to try to hurry the process along. This can result in an oily layer on top of your caramels. If you need to adjust the burner up or down, do it very, very gradually.