Hugging Face model: pr4nav101/Tiny-Thought-Model-Distilled-Llama-3.2-1B-Instruct-bnb-4bit
Author: pr4nav101
Created: 2025-02-05 08:24:05
Last modified: 2025-02-16 10:06:19
Pipeline: text-generation
Library: peft
Likes: 0 | Downloads: 2
Tags: peft, safetensors, COT, TTM, LLM, text-generation, en, dataset:pr4nav101/COT_TTM_Finetuning, base_model:pr4nav101/llama-3-8b-Instruct-bnb-4bit-Tiny-Thought-Model-Large, base_model:adapter:pr4nav101/llama-3-8b-Instruct-bnb-4bit-Tiny-Thought-Model-Large, license:mit, region:us
Base model relation: adapter
Base models: id: pr4nav101/llama-3-8b-Instruct-bnb-4bit-Tiny-Thought-Model-Large
Card metadata:
license: mit
datasets: pr4nav101/COT_TTM_Finetuning
language: en
base_model: unsloth/Llama-3.2-1B-Instruct-bnb-4bit, pr4nav101/llama-3-8b-Instruct-bnb-4bit-Tiny-Thought-Model-Large
pipeline_tag: text-generation
library_name: peft
tags: COT, TTM, LLM
method: Knowledge Distillation with Reverse KL Divergence + PEFT Finetuning