Fruit persisting into winter provides color in the winter landscape. A Shrub may produce beautiful fruit but too few to be noticed, so their ornamental value is low. Within limits, the larger the fruit the more ornamental it will be. Large fruit can be a problem to clean up. Don't plant shrubs with poisonous berries near public walkways.
Some shrubs produce fruits eaten by birds.
This may be a reason for selecting a particular shrub. Foliage color, other than green, can occur in fall, in spring, or from spring to fall. Spring only foliage color fades to green or off green by summer. Colored foliage shrubs can be less vigorous than the same plant with green foliage. Shrubs with variegated leaves may not be as vigorous as the same species with green leaves.