No need to remove old mulch before adding a new layer of mulch. Mulch will break down over time if you just let it do its thing. But it does help to loosen up the old mulch first with a rake to make sure that air can still move and water can drain through.