ByteWritable cleanup

Stuff we talked about @raronson which I kept separate to make it easy to review.