Revert "fixed single bite conversion from signed to unsigned for 'b' frames"

This reverts commit 4e7a877e1ac88bf836b4223297f23aa3e09321d4.

Breaks some of the tests.