Revert "V4A fixes/ Improve quaility a lot"

1) This breaks Chromecast audio and WiFi Display Sound
2) Power Consumption is higher when listening to audio.
3) I'm not really noticing a huge difference here so it's not worth 1 or 2.

This reverts commit 3464308d27038089f13e11afd6d7cad3db54237d.
Change-Id: I16b2c82dd6f4a8ae194e461bd0c3039e2e3fd909