Example of streaming hugging face transformers inference
#3
by
sujitvasanth
- opened
Hi I used your model to make a terminal chat demo using streaming
thought it might help anyone wanting to get started quickly on this excellent model there is a gif of it working here
https://github.com/sujitvasanth/streaming-LLM-chat