GitHub repository: mymagicai/petals-optimise-llama
Primary language: Python
Description: 🌸 Run LLMs at home, BitTorrent-style. Fine-tuning and inference up to 10x faster than offloading