Luciano Zanuz

Luciano

AI & ML interests

None yet

Recent Activity

Organizations

Spaces-explorers's profile picture

Luciano's activity

reacted to philschmid's post with โค๏ธ 12 months ago
view post
Post
What's the best way to fine-tune open LLMs in 2024? Look no further! ๐Ÿ‘€ I am excited to share โ€œHow to Fine-Tune LLMs in 2024 with Hugging Faceโ€ using the latest research techniques, including Flash Attention, Q-LoRA, OpenAI dataset formats (messages), ChatML, Packing, all built with Hugging Face TRL. ๐Ÿš€

It is created for consumer-size GPUs (24GB) covering the full end-to-end lifecycle with:
๐Ÿ’กDefine and understand use cases for fine-tuning
๐Ÿง‘๐Ÿปโ€๐Ÿ’ป Setup of the development environment
๐Ÿงฎ Create and prepare dataset (OpenAI format)
๐Ÿ‹๏ธโ€โ™€๏ธ Fine-tune LLM using TRL and the SFTTrainer
๐Ÿฅ‡ Test and evaluate the LLM
๐Ÿš€ Deploy for production with TGI

๐Ÿ‘‰  https://www.philschmid.de/fine-tune-llms-in-2024-with-trl

Coming soon: Advanced Guides for multi-GPU/multi-Node full fine-tuning and alignment using DPO & KTO. ๐Ÿ”œ
ยท