Yes and no. The cans of condensed milk sold in the store are specifically designed to withstand the high pressure that builds up when heated. However, they can explode if the cans of condensed milk get dented or are not completely submerged in the water. If the water evaporates and exposes the can to air, or if the can is damaged in any way, it is not safe to boil cans of condensed milk.