torch==2.0.1
deepspeed
sentencepiece
accelerate
git+https://github.com/huggingface/transformers.git
transformers_stream_generator
plotly