Hugging Face model: HenryHHHH/DistilLlamaV1
Author: HenryHHHH
Created: 2024-11-01 08:32:31
Last modified: 2024-11-06 02:12:13
Pipeline: text-generation
Library: transformers
Likes: 0 | Downloads: 12
Tags: transformers, safetensors, llama, text-generation, knowledge-distillation, causal-lm, openwebtext, wikitext, transfer-learning, en, dataset:openwebtext, dataset:wikitext, arxiv:2308.02019, license:apache-2.0, text-generation-inference, endpoints_compatible, region:us
Card metadata:
language: en
tags: text-generation, knowledge-distillation, llama, causal-lm, openwebtext, wikitext, transfer-learning
model_name: DistilLLaMA
license: apache-2.0
datasets: openwebtext, wikitext
parameter_count: 80M
metrics: cosine-similarity, exact-match, rouge
library_name: transformers
base_model: meta-llama/LLaMA-2-7B