Do you mean ".intValue" and "+" cause constantly boxing and unboxing the numbers? Can we use unchecked-add-int and unchecked-multiply-int to avoid boxing and unboxing? 
I tested with unchecked-* and it's 10% faster than ".intValue" and "+" on 100KB and 1000KB byte array.