Handle cases with a stream of uneven number of channels