github.com/bytedance/lightseq (go): LightSeq: A High Performance Library for Sequence Processing and Generation
Keywords: accelerate|bart|beam-search|bert|cuda|diverse-decoding|gpt|inference|multilingual-nmt|sampling|training|transformer