Don't throw away byte buffer if we couldn't parse a protobuf.

Thanks to Dave Melcher for the catch.