Yes, candy canes do melt in the oven. If there are too many candy cane bits in the cookies then they will lose their shape. To avoid this, sift the peppermint dust out of the crushed candy cane and only press candy cane bits on top of the dough balls.