gradio
transformers[torch]
accelerate
git+https://github.com/huggingface/peft.git
bitsandbytes
einops
trl