SmolFactory / requirements.txt
Tonic's picture
improves requirements and dependencies
0de9de2 verified
raw
history blame
690 Bytes
# Core dependencies - essential for training
torch>=2.0.0
transformers>=4.53.0
datasets>=2.14.0
accelerate>=0.20.0
trl>=0.7.0
# Hugging Face ecosystem
huggingface-hub>=0.16.0
tokenizers>=0.13.0
# Training and optimization
flash-attn>=2.0.0
bitsandbytes>=0.41.0
# Basic utilities
numpy>=1.24.0
tqdm>=4.65.0
# Experiment tracking
trackio>=0.1.0
# Optional: for evaluation (commented out to reduce conflicts)
# lighteval>=0.1.0
# evaluate>=0.4.0
# Optional: for deployment (commented out to reduce conflicts)
# vllm>=0.2.0
# sentencepiece>=0.1.99
# Development tools (commented out to reduce conflicts)
# pytest>=7.0.0
# black>=23.0.0
# isort>=5.12.0
# System monitoring
psutil>=5.9.0