Revert "downmix: Fix aliasing violation"

This reverts commit 6370487ccb5e3229de3f957454e72e512e17ff89.