Model: bekalebendong/pendo-gpt2-medium-teacher
Author: bekalebendong
Pipeline: text-generation
Tags: safetensors, gpt2, text-generation, knowledge-distillation, teacher-model, wikitext, causal-lm, pytorch, en, dataset:wikitext, license:mit, model-index, region:us
Card metadata: language: en
license: mit
tags: text-generation, gpt2, knowledge-distillation, teacher-model, wikitext, causal-lm, pytorch
datasets: wikitext
metrics: perplexity, loss
model-index: name: bekalebendong/pendo-gpt2-medium-teacher
results: task: type: text-generation
name: Text Generation
dataset: name: WikiText-103 (full) + Wikipedia EN (20231101, 30%)
type: wikitext
metrics: type: loss
value: 2.706
name: Validation Loss
verified: no, type: perplexity
value: ~15
name: Perplexity
verified: no
pipeline_tag: text-generation
widget: text: The history of
example_title: History Example, text: In the field of science,
example_title: Science Example, text: Machine learning is
example_title: ML Example
Likes: 0 | All-time downloads: 36
Created: 2025-11-08 03:28:49