Be more defensive about averaging empty series.