Open-Source AI Cookbook

The Open-Source AI Cookbook is a collection of notebooks illustrating practical aspects of building AI applications and solving various machine learning tasks using open-source tools and models.

Latest notebooks

Check out the recently added notebooks:

• Multimodal Retrieval-Augmented Generation (RAG) with Document Retrieval (ColPali) and Vision Language Models (VLMs)
• Fine-Tuning a Vision Language Model (Qwen2-VL-7B) with the Hugging Face Ecosystem (TRL)
• Multi-agent RAG System 🤖🤝🤖
• Multimodal RAG with ColQwen2, Reranker, and Quantized VLMs on Consumer GPUs
• Fine-tuning SmolVLM with TRL on a consumer GPU
• Smol Multimodal RAG: Building with ColSmolVLM and SmolVLM on Colab’s Free-Tier GPU
• Fine-tuning SmolVLM using direct preference optimization (DPO) with TRL on a consumer GPU

You can also check out the notebooks in the cookbook’s GitHub repo.

Contributing

The Open-Source AI Cookbook is a community effort, and we welcome contributions from everyone! Check out the cookbook’s Contribution guide to learn how you can add your “recipe”.

< > Update on GitHub