There is no taking of life, instead the fruit is offered as part of a symbiotic pact between plant, animal and the earth. The plant remains intact and benefits from the interaction. Not only does it get to reproduce through the sowing of it's seed, but also the more delicious the fruit, the more chance that we will nurture that seed and, feed, water and care for it, until and after it brings to bare it's own fruit. Many people have never planted a fruit tree as they think they do not own land. This is a mistake.
Life gives unto life.
Do not be put off by feeling you must always get permission. Nature sows without asking. You are part of nature. Reconstituting the world, and working toward paradise is a duty and a right which extends beyond so called legal concepts of ownership. Do not worry too much about losses.