Once you place a wall in twig, a 10-minute countdown starts. During these 10 minutes, you can choose to pull the wall down by equipping a building hammer, right-clicking on the wall, and selecting the demolish icon.