Coconut sugar can be substituted for regular sugar in the caramel coffee creamer recipe. It will provide a slightly different flavor profile, but it should still work well in enhancing the sweetness and caramel notes of the creamer.