Yes, if you restrict too much and your body goes into starvation mode, it can slow your metabolism and actually cause you to gain weight. Also, if you only eat highly processed diet foods, they can be high in calories and sugar and lead to weight gain.