Llama3 8B QLora Fine Tuning CoT #machinelearning #datascience
Channel: The Machine Learning Engineer
Date: 20/04/2024

In this video I will show you how to fine tune a Llama3 8B model using QLora with a CoT dataset( chain-of-thought)

Notebooks:
LLama3  8B
https://github.com/olonok69/LLM_Notebooks/blob/main/llama2/Llama3_8b_instruct_qlora_CoT_Fine_Tune.ipynb

Llama2 7B
https://github.com/olonok69/LLM_Notebooks/blob/main/llama2/Llama2_7b_instruct_qlora_CoT_Fine_Tune_v2.ipynb

Mistral 7B
https://github.com/olonok69/LLM_Notebooks/blob/main/mistral/Mistral7b_instruct_qlora_CoT_Fine_Tune_v2.ipynb