Hugging Face model: HenryHHHH/DistilLlama
Author: HenryHHHH
Created: 2024-10-23 07:46:58
Last modified: 2024-10-24 08:20:19
Pipeline: text-generation
Library: transformers
Likes: 3 | Downloads: 14
Tags: transformers, safetensors, llama, text-generation, knowledge-distillation, causal-lm, openwebtext, wikitext, transfer-learning, en, dataset:openwebtext, dataset:wikitext, arxiv:2308.02019, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
language: en
tags: text-generation, knowledge-distillation, llama, causal-lm, openwebtext, wikitext, transfer-learning
model_name: DistilLLaMA
license: apache-2.0
datasets: openwebtext, wikitext
parameter_count: 80M
metrics: cosine-similarity, exact-match, rouge
library_name: transformers
base_model: meta-llama/LLaMA-2-7B