Oops, I just saved almost half of our byte[] allocations

~310MB vs ~170MB of byte[]
Optimized ReadBit()

Once again, it's amazing to see how big the impact of such small optimizations can be.