Use a better keyserver. Convert message to bytes from bytearray so that it works.