Use bufio.Reader.ReadByte instead of binary.Read for single bytes