If you don't, the cardboard disintegrates and you have these weird strips of packing tape in your garden! Anything plastic or tape-like on the box needs to be pulled off.