No. Even if you take the sapling, Asta will forever tell you that you're no longer welcome in Eldergleam Sanctuary. You can chalk it up to being the average Bethesda oversight.