torch
accelerate
bitsandbytes
gradio
protobuf
transformers
packaging
ninja
flash-attn