SmolFactory / requirements_minimal.txt
Tonic's picture
removes flash attention from reqs
e8aadec verified
raw
history blame
265 Bytes
# Minimal requirements for SmolLM3 training
torch>=2.0.0
transformers>=4.53.0
datasets>=2.14.0
accelerate>=0.20.0
trl>=0.7.0
huggingface-hub>=0.16.0
tokenizers>=0.13.0
# flash-attn>=2.0.0
bitsandbytes>=0.41.0
numpy>=1.24.0
tqdm>=4.65.0
trackio>=0.1.0
psutil>=5.9.0