Remove the decimal value for the current byte