Heree's a requirements.txt that worked for me, slightly updated:
flash-attn==2.7.4.post1
scipy==1.15.2
torch==2.6.0
cffi==1.17.1
transformers==4.49.0
peft==0.14.0
accelerate==1.5.1
trl==0.15.2
bitsandbytes==0.45.3
datasets==3.3.2
huggingface-hub==0.29.3
safetensors==0.5.3
pandas==2.2.3
matplotlib==3.10.1
numpy==1.26.4
