Bug: scan ipc.RpcServer: Unexpected throwable object 
Status: Open | Priority: Critical | Resolution: 
Created: 03/Nov/22 02:11
Affects Version/s: 2.3.5

regionserver日志：

2022-11-03 02:05:37,113 WARN  [RpcServer.default.FPBQ.Fifo.handler=43,queue=3,port=16020] hfile.BlockCacheUtil: Caching an already cached block: 683273027345

48448d8384bea82dd541_SeqId_6__346562037. This is harmless and can happen in rare cases (see HBASE-8547)

2022-11-03 02:05:37,113 WARN  [RpcServer.default.FPBQ.Fifo.handler=22,queue=2,port=16020] hfile.BlockCacheUtil: Caching an already cached block: 297c0c67dd78

40b5829c4dae5342664b_SeqId_4__346562037. This is harmless and can happen in rare cases (see HBASE-8547)

2022-11-03 02:05:37,114 WARN  [RpcServer.default.FPBQ.Fifo.handler=43,queue=3,port=16020] hfile.BlockCacheUtil: Caching an already cached block: 683273027345

48448d8384bea82dd541_SeqId_6__346590844. This is harmless and can happen in rare cases (see HBASE-8547)

2022-11-03 02:05:37,114 WARN  [RpcServer.default.FPBQ.Fifo.handler=22,queue=2,port=16020] hfile.BlockCacheUtil: Caching an already cached block: 683273027345

48448d8384bea82dd541_SeqId_6__346590844. This is harmless and can happen in rare cases (see HBASE-8547)

2022-11-03 02:05:37,114 WARN  [RpcServer.default.FPBQ.Fifo.handler=43,queue=3,port=16020] hfile.BlockCacheUtil: Cached block contents differ by nextBlockOnDi

skSize, the new block has nextBlockOnDiskSize set. Caching new block.

2022-11-03 02:05:37,115 ERROR [RpcServer.default.FPBQ.Fifo.handler=22,queue=2,port=16020] ipc.RpcServer: Unexpected throwable object 

java.lang.IllegalArgumentException: offset (0) + length (2) exceed the capacity of the array: -1207959040

        at org.apache.hadoop.hbase.util.Bytes.explainWrongLengthOrOffset(Bytes.java:832)

        at org.apache.hadoop.hbase.util.Bytes.toShort(Bytes.java:1125)

        at org.apache.hadoop.hbase.util.Bytes.toShort(Bytes.java:1111)

        at org.apache.hadoop.hbase.io.encoding.DiffKeyDeltaEncoder$DiffSeekerStateBufferedEncodedSeeker.decode(DiffKeyDeltaEncoder.java:439)

        at org.apache.hadoop.hbase.io.encoding.DiffKeyDeltaEncoder$DiffSeekerStateBufferedEncodedSeeker.decodeNext(DiffKeyDeltaEncoder.java:527)

        at org.apache.hadoop.hbase.io.encoding.BufferedDataBlockEncoder$BufferedEncodedSeeker.next(BufferedDataBlockEncoder.java:806)

        at org.apache.hadoop.hbase.io.hfile.HFileReaderImpl$EncodedScanner.next(HFileReaderImpl.java:1512)

        at org.apache.hadoop.hbase.regionserver.StoreFileScanner.next(StoreFileScanner.java:196)

        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:124)

        at org.apache.hadoop.hbase.regionserver.StoreScanner.trySkipToNextColumn(StoreScanner.java:917)

        at org.apache.hadoop.hbase.regionserver.StoreScanner.seekOrSkipToNextColumn(StoreScanner.java:826)

        at org.apache.hadoop.hbase.regionserver.StoreScanner.next(StoreScanner.java:738)

        at org.apache.hadoop.hbase.regionserver.KeyValueHeap.next(KeyValueHeap.java:157)

        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.populateResult(HRegion.java:6794)

        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextInternal(HRegion.java:6958)

        at org.apache.hadoop.hbase.regionserver.HRegion$RegionScannerImpl.nextRaw(HRegion.java:6728)

        at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3323)

        at org.apache.hadoop.hbase.regionserver.RSRpcServices.scan(RSRpcServices.java:3574)

        at org.apache.hadoop.hbase.shaded.protobuf.generated.ClientProtos$ClientService$2.callBlockingMethod(ClientProtos.java:44858)

        at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:393)

        at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:133)

        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:338)

        at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:318)