To remove a butterfly bush from your garden, cut it down to the ground and dig out the roots as thoroughly as possible.