It is not necessary to remove old mulch before replacing it. Even old mulch can still be beneficial for the plants as it decomposes. Some homeowners prefer to remove it, but many will leave it and simply mulch over it.