Using a heat gun, oven, or another method, warm the insole. When the shoe is sufficiently heated, try pulling out the insole with a spoon or lever. Once the heel is successfully removed, carefully remove the remaining portion of the shoe.