flash_attn
torch==2.0.1
deepspeed
sentencepiece
accelerate
transformers
transformers_stream_generator
plotly