Fix regression in commit c50864e on downmix multi-channel audio.

AVCodecContex->channels can change after decoding.