Optimized for one byte xor.