Apple cider vinegar mixed with sugar makes a great substitute in an orange chicken recipe. Mix equal parts vinegar and water to the required amount of liquid for the dish. Then add in some sugar or sweetener to taste. You can also use orange marmalade thinned with water.