transformers-stream-generator (pypi): This is a text generation method which returns a generator, streaming out each token in real-time during inference, based on Huggingface/Transformers.
Keywords: GPT|stream|transformers|NLP|model hub|transformer|text generation|summarization|translation|q&a|qg|machine learning|CausalLM|gpt|stream-generator|text-generation