Hugging Face model: NamrataThakur/Small_Language_Model_GQA_48M_Pretrained
Author: NamrataThakur
Created: 2026-02-21 11:38:47
Last modified: 2026-03-17 11:08:26
Pipeline: text-generation
Likes: 1 | Downloads: 7
Tags: pytorch, customGPT_pretrain, Pretrain, SLM, Group_Query_Attention, Custom_Model, From_Scratch, tiny-model, research, text-generation, en, dataset:roneneldan/TinyStories, arxiv:1910.09700, license:mit, region:us
Card metadata:
license: mit
datasets: roneneldan/TinyStories
language: en
pipeline_tag: text-generation
tags: Pretrain, SLM, Group_Query_Attention, Custom_Model, From_Scratch, tiny-model, research