Toffee generally does not include brown sugar as an ingredient and brown sugar is usually found in butterscotch. The candy is also cooked at a higher temperature, making it harder and less pliable than butterscotch.