Fruit trees should ideally be pruned annually during their dormant season to maximize fruit production and overall health.