Acquire left/right channels from the source instead of directly indexing the buffers