Only splice if there's something to remove