gradio
torch
transformers==4.40.0
-i https://pypi.org/simple/ bitsandbytes
accelerate