renderer: drop special casing for non buffered playback

If we need to reduce buffer count during rewind, we
should do just that, reduce buffer count to 2.