Make field access via ByteBuf.read/write*() faster by avoiding unnecessary boundary checks

- also disabled a time consuming test that is actually a regression test