In short caramel is make with white cane sugar while toffee is made with brown sugar. Dulce de leche is made by slowly heating sweetened condensed milk.