Remove SVG marker group element when path removed.