Hugging Face model: celestialcreator/Llama-3.2-1B-MTP-k8
Author: celestialcreator
Created: 2026-03-05 09:51:21
Last modified: 2026-03-05 10:51:57
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 24
Tags: transformers, pytorch, llama, text-generation, multi-token-prediction, speculative-decoding, self-distillation, mtp, consumer-gpu, rtx-5090, paper-reproduction, custom_code, en, dataset:jwkirchenbauer/metamathqa-grouped-split, arxiv:2602.06019, base_model:meta-llama/Llama-3.2-1B, base_model:finetune:meta-llama/Llama-3.2-1B, license:llama3.2, model-index, text-generation-inference, endpoints_compatible, region:us
Base model relation: finetune
Base models: id: meta-llama/Llama-3.2-1B
Card metadata:
license: llama3.2
base_model: meta-llama/Llama-3.2-1B
tags: multi-token-prediction, speculative-decoding, self-distillation, mtp, llama, consumer-gpu, rtx-5090, paper-reproduction
datasets: jwkirchenbauer/metamathqa-grouped-split
language: en
pipeline_tag: text-generation
library_name: transformers