Since lime trees grow an abundant crop, some falling of individual fruit is normal and expected. Excessive fruit falling from the tree can be caused from uneven or inconsistent watering, as well as a soil pH that is either too alkaline or acidic.