Each plugin gets its own processing buffer

This should hopefully resolve a number of channel-conversion related bugs,
such as #156 and #164.