vllm
transformers
langchain
accelerate
bitsandbytes
sentencepiece
gradio