torch
git+https://github.com/huggingface/transformers
accelerate
optimum
flash-attn