Remove leftover in the byte string