Look in all time slices for the maximum label.